2023-10-05 03:00:19,664 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-05 03:00:19,888 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae 2023-10-05 03:00:19,888 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-05 03:00:19,888 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-05 03:00:19,931 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-05 03:00:20,171 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-05 03:00:20,172 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7, deleteOnExit=true 2023-10-05 03:00:20,172 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-05 03:00:20,172 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/test.cache.data in system properties and HBase conf 2023-10-05 03:00:20,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 03:00:20,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop.log.dir in system properties and HBase conf 2023-10-05 03:00:20,173 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 03:00:20,174 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 03:00:20,174 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 03:00:20,492 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-05 03:00:20,497 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 03:00:20,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 03:00:20,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 03:00:20,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 03:00:20,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 03:00:20,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 03:00:20,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 03:00:20,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 03:00:20,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 03:00:20,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/nfs.dump.dir in system properties and HBase conf 2023-10-05 03:00:20,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir in system properties and HBase conf 2023-10-05 03:00:20,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 03:00:20,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 03:00:20,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-05 03:00:21,034 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 03:00:21,039 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 03:00:21,376 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-05 03:00:21,571 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-05 03:00:21,590 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:21,631 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:21,669 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_localhost_34881_hdfs____.mlkyzq/webapp 2023-10-05 03:00:21,833 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34881 2023-10-05 03:00:21,845 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 03:00:21,845 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 03:00:22,333 WARN [Listener at localhost/34213] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 03:00:22,407 WARN [Listener at localhost/34213] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 03:00:22,429 WARN [Listener at localhost/34213] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:22,486 INFO [Listener at localhost/34213] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:22,495 INFO [Listener at localhost/34213] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_localhost_42999_datanode____uovs5e/webapp 2023-10-05 03:00:22,612 INFO [Listener at localhost/34213] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42999 2023-10-05 03:00:23,009 WARN [Listener at localhost/34557] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 03:00:23,024 WARN [Listener at localhost/34557] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 03:00:23,027 WARN [Listener at localhost/34557] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:23,029 INFO [Listener at localhost/34557] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:23,038 INFO [Listener at localhost/34557] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_localhost_33651_datanode____.2o0eg7/webapp 2023-10-05 03:00:23,138 INFO [Listener at localhost/34557] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33651 2023-10-05 03:00:23,149 WARN [Listener at localhost/44525] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 03:00:23,163 WARN [Listener at localhost/44525] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 03:00:23,171 WARN [Listener at localhost/44525] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:23,172 INFO [Listener at localhost/44525] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:23,178 INFO [Listener at localhost/44525] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_localhost_41375_datanode____.3anpt1/webapp 2023-10-05 03:00:23,306 INFO [Listener at localhost/44525] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41375 2023-10-05 03:00:23,341 WARN [Listener at localhost/41459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 03:00:23,656 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x936a90188fd0de08: Processing first storage report for DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3 from datanode 617c9964-e384-4c17-ae3f-42a0981fc6b3 2023-10-05 03:00:23,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x936a90188fd0de08: from storage DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3 node DatanodeRegistration(127.0.0.1:41117, datanodeUuid=617c9964-e384-4c17-ae3f-42a0981fc6b3, infoPort=39475, infoSecurePort=0, ipcPort=41459, storageInfo=lv=-57;cid=testClusterID;nsid=1221061500;c=1696474821124), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-05 03:00:23,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6235c295e5324d73: Processing first storage report for DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19 from datanode 9f99bb15-9072-4003-b9dd-e76635408c49 2023-10-05 03:00:23,659 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6235c295e5324d73: from storage DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19 node DatanodeRegistration(127.0.0.1:39385, datanodeUuid=9f99bb15-9072-4003-b9dd-e76635408c49, infoPort=33347, infoSecurePort=0, ipcPort=44525, storageInfo=lv=-57;cid=testClusterID;nsid=1221061500;c=1696474821124), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-05 03:00:23,659 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d005c2c48bd7914: Processing first storage report for DS-73649375-7b68-482e-8fec-38ef0f0bbf57 from datanode 0b01e733-b3f1-4237-b5b8-0a4ba66bc8ed 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d005c2c48bd7914: from storage DS-73649375-7b68-482e-8fec-38ef0f0bbf57 node DatanodeRegistration(127.0.0.1:39499, datanodeUuid=0b01e733-b3f1-4237-b5b8-0a4ba66bc8ed, infoPort=46315, infoSecurePort=0, ipcPort=34557, storageInfo=lv=-57;cid=testClusterID;nsid=1221061500;c=1696474821124), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x936a90188fd0de08: Processing first storage report for DS-1930a865-309d-402f-86c5-cb6faa3f811a from datanode 617c9964-e384-4c17-ae3f-42a0981fc6b3 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x936a90188fd0de08: from storage DS-1930a865-309d-402f-86c5-cb6faa3f811a node DatanodeRegistration(127.0.0.1:41117, datanodeUuid=617c9964-e384-4c17-ae3f-42a0981fc6b3, infoPort=39475, infoSecurePort=0, ipcPort=41459, storageInfo=lv=-57;cid=testClusterID;nsid=1221061500;c=1696474821124), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6235c295e5324d73: Processing first storage report for DS-7c2e2cae-e026-48c7-bdb1-f8f385bc72a9 from datanode 9f99bb15-9072-4003-b9dd-e76635408c49 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6235c295e5324d73: from storage DS-7c2e2cae-e026-48c7-bdb1-f8f385bc72a9 node DatanodeRegistration(127.0.0.1:39385, datanodeUuid=9f99bb15-9072-4003-b9dd-e76635408c49, infoPort=33347, infoSecurePort=0, ipcPort=44525, storageInfo=lv=-57;cid=testClusterID;nsid=1221061500;c=1696474821124), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d005c2c48bd7914: Processing first storage report for DS-3f7f2513-9a70-4fd3-a8e6-aa6f31085cb9 from datanode 0b01e733-b3f1-4237-b5b8-0a4ba66bc8ed 2023-10-05 03:00:23,660 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d005c2c48bd7914: from storage DS-3f7f2513-9a70-4fd3-a8e6-aa6f31085cb9 node DatanodeRegistration(127.0.0.1:39499, datanodeUuid=0b01e733-b3f1-4237-b5b8-0a4ba66bc8ed, infoPort=46315, infoSecurePort=0, ipcPort=34557, storageInfo=lv=-57;cid=testClusterID;nsid=1221061500;c=1696474821124), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-05 03:00:23,882 DEBUG [Listener at localhost/41459] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae 2023-10-05 03:00:23,969 INFO [Listener at localhost/41459] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/zookeeper_0, clientPort=56535, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-05 03:00:23,995 INFO [Listener at localhost/41459] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56535 2023-10-05 03:00:24,004 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:24,007 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:24,716 INFO [Listener at localhost/41459] util.FSUtils(471): Created version file at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f with version=8 2023-10-05 03:00:24,717 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/hbase-staging 2023-10-05 03:00:25,082 INFO [Listener at localhost/41459] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-05 03:00:25,569 INFO [Listener at localhost/41459] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 03:00:25,601 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:25,602 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:25,602 INFO [Listener at localhost/41459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 03:00:25,602 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:25,602 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 03:00:25,759 INFO [Listener at localhost/41459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 03:00:25,832 DEBUG [Listener at localhost/41459] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-05 03:00:25,926 INFO [Listener at localhost/41459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35405 2023-10-05 03:00:25,939 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:25,941 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:25,965 INFO [Listener at localhost/41459] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35405 connecting to ZooKeeper ensemble=127.0.0.1:56535 2023-10-05 03:00:26,023 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:354050x0, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 03:00:26,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35405-0x1011486b4b10000 connected 2023-10-05 03:00:26,061 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 03:00:26,061 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:00:26,074 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 03:00:26,086 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35405 2023-10-05 03:00:26,086 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35405 2023-10-05 03:00:26,087 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35405 2023-10-05 03:00:26,087 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35405 2023-10-05 03:00:26,088 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35405 2023-10-05 03:00:26,094 INFO [Listener at localhost/41459] master.HMaster(444): hbase.rootdir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, hbase.cluster.distributed=false 2023-10-05 03:00:26,157 INFO [Listener at localhost/41459] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 03:00:26,158 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,158 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,158 INFO [Listener at localhost/41459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 03:00:26,158 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,158 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 03:00:26,163 INFO [Listener at localhost/41459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 03:00:26,166 INFO [Listener at localhost/41459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39035 2023-10-05 03:00:26,169 INFO [Listener at localhost/41459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 03:00:26,175 INFO [Listener at localhost/41459] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 03:00:26,177 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,179 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,182 INFO [Listener at localhost/41459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39035 connecting to ZooKeeper ensemble=127.0.0.1:56535 2023-10-05 03:00:26,186 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:390350x0, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 03:00:26,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39035-0x1011486b4b10001 connected 2023-10-05 03:00:26,187 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 03:00:26,189 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:00:26,190 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 03:00:26,191 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39035 2023-10-05 03:00:26,191 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39035 2023-10-05 03:00:26,191 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39035 2023-10-05 03:00:26,192 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39035 2023-10-05 03:00:26,193 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39035 2023-10-05 03:00:26,206 INFO [Listener at localhost/41459] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 03:00:26,206 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,206 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,207 INFO [Listener at localhost/41459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 03:00:26,207 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,207 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 03:00:26,208 INFO [Listener at localhost/41459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 03:00:26,210 INFO [Listener at localhost/41459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33679 2023-10-05 03:00:26,210 INFO [Listener at localhost/41459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 03:00:26,211 INFO [Listener at localhost/41459] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 03:00:26,212 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,215 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,218 INFO [Listener at localhost/41459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33679 connecting to ZooKeeper ensemble=127.0.0.1:56535 2023-10-05 03:00:26,223 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:336790x0, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 03:00:26,224 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:336790x0, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 03:00:26,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33679-0x1011486b4b10002 connected 2023-10-05 03:00:26,225 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:00:26,226 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 03:00:26,227 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33679 2023-10-05 03:00:26,227 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33679 2023-10-05 03:00:26,227 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33679 2023-10-05 03:00:26,228 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33679 2023-10-05 03:00:26,228 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33679 2023-10-05 03:00:26,249 INFO [Listener at localhost/41459] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 03:00:26,249 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,250 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,250 INFO [Listener at localhost/41459] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 03:00:26,250 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 03:00:26,250 INFO [Listener at localhost/41459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 03:00:26,250 INFO [Listener at localhost/41459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 03:00:26,252 INFO [Listener at localhost/41459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42403 2023-10-05 03:00:26,253 INFO [Listener at localhost/41459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 03:00:26,254 INFO [Listener at localhost/41459] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 03:00:26,255 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,257 INFO [Listener at localhost/41459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,259 INFO [Listener at localhost/41459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42403 connecting to ZooKeeper ensemble=127.0.0.1:56535 2023-10-05 03:00:26,263 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:424030x0, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 03:00:26,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42403-0x1011486b4b10003 connected 2023-10-05 03:00:26,264 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 03:00:26,265 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:00:26,266 DEBUG [Listener at localhost/41459] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 03:00:26,269 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42403 2023-10-05 03:00:26,269 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42403 2023-10-05 03:00:26,270 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42403 2023-10-05 03:00:26,271 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42403 2023-10-05 03:00:26,273 DEBUG [Listener at localhost/41459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42403 2023-10-05 03:00:26,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:26,286 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 03:00:26,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:26,308 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 03:00:26,308 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 03:00:26,308 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 03:00:26,308 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 03:00:26,309 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:26,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 03:00:26,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35405,1696474824903 from backup master directory 2023-10-05 03:00:26,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 03:00:26,316 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:26,316 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 03:00:26,317 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 03:00:26,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:26,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-05 03:00:26,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-05 03:00:26,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/hbase.id with ID: d0726588-88f3-4ff0-915e-62171d04d58c 2023-10-05 03:00:26,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 03:00:26,483 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:26,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x40e13c8f to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:26,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fd46b91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:26,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 03:00:26,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-05 03:00:26,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-05 03:00:26,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-05 03:00:26,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 03:00:26,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 03:00:26,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 03:00:26,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store-tmp 2023-10-05 03:00:26,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:26,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 03:00:26,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:00:26,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:00:26,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 03:00:26,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:00:26,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:00:26,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 03:00:26,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/WALs/jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:26,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35405%2C1696474824903, suffix=, logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/WALs/jenkins-hbase4.apache.org,35405,1696474824903, archiveDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/oldWALs, maxLogs=10 2023-10-05 03:00:26,793 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK] 2023-10-05 03:00:26,793 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK] 2023-10-05 03:00:26,793 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK] 2023-10-05 03:00:26,802 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-05 03:00:26,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/WALs/jenkins-hbase4.apache.org,35405,1696474824903/jenkins-hbase4.apache.org%2C35405%2C1696474824903.1696474826739 2023-10-05 03:00:26,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK], DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK], DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK]] 2023-10-05 03:00:26,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-05 03:00:26,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:26,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 03:00:26,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 03:00:26,945 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-05 03:00:26,953 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-05 03:00:26,986 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-05 03:00:26,998 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:27,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 03:00:27,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 03:00:27,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 03:00:27,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:27,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63134282, jitterRate=-0.059225887060165405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:27,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 03:00:27,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-05 03:00:27,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-05 03:00:27,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-05 03:00:27,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-05 03:00:27,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-05 03:00:27,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-10-05 03:00:27,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-05 03:00:27,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-05 03:00:27,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-05 03:00:27,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-05 03:00:27,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-05 03:00:27,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-05 03:00:27,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-05 03:00:27,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-05 03:00:27,182 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:27,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-05 03:00:27,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-05 03:00:27,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-05 03:00:27,209 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 03:00:27,209 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 03:00:27,209 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:27,209 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 03:00:27,209 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 03:00:27,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,35405,1696474824903, sessionid=0x1011486b4b10000, setting cluster-up flag (Was=false) 2023-10-05 03:00:27,226 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:27,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-05 03:00:27,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:27,241 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:27,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-05 03:00:27,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:27,250 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp 2023-10-05 03:00:27,278 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(951): ClusterId : d0726588-88f3-4ff0-915e-62171d04d58c 2023-10-05 03:00:27,279 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(951): ClusterId : d0726588-88f3-4ff0-915e-62171d04d58c 2023-10-05 03:00:27,278 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(951): ClusterId : d0726588-88f3-4ff0-915e-62171d04d58c 2023-10-05 03:00:27,285 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 03:00:27,285 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 03:00:27,285 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 03:00:27,292 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 03:00:27,292 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 03:00:27,292 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 03:00:27,293 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 03:00:27,292 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 03:00:27,293 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 03:00:27,296 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 03:00:27,296 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 03:00:27,296 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 03:00:27,299 DEBUG [RS:1;jenkins-hbase4:33679] zookeeper.ReadOnlyZKClient(139): Connect 0x42c21170 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:27,300 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ReadOnlyZKClient(139): Connect 0x294828c6 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:27,300 DEBUG [RS:0;jenkins-hbase4:39035] zookeeper.ReadOnlyZKClient(139): Connect 0x17398b43 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:27,312 DEBUG [RS:1;jenkins-hbase4:33679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c05f758, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:27,312 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@278fc39f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:27,313 DEBUG [RS:1;jenkins-hbase4:33679] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@483a7a00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 03:00:27,313 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23b043b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 03:00:27,348 DEBUG [RS:0;jenkins-hbase4:39035] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19fe67d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:27,348 DEBUG [RS:0;jenkins-hbase4:39035] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dc1e033, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 03:00:27,375 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39035 2023-10-05 03:00:27,379 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42403 2023-10-05 03:00:27,380 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33679 2023-10-05 03:00:27,381 INFO [RS:2;jenkins-hbase4:42403] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 03:00:27,381 INFO [RS:0;jenkins-hbase4:39035] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 03:00:27,381 INFO [RS:0;jenkins-hbase4:39035] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 03:00:27,381 INFO [RS:2;jenkins-hbase4:42403] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 03:00:27,381 INFO [RS:1;jenkins-hbase4:33679] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 03:00:27,382 INFO [RS:1;jenkins-hbase4:33679] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 03:00:27,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-05 03:00:27,388 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 03:00:27,388 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 03:00:27,388 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 03:00:27,390 INFO [RS:0;jenkins-hbase4:39035] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:27,390 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 03:00:27,390 INFO [RS:2;jenkins-hbase4:42403] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:27,391 INFO [RS:1;jenkins-hbase4:33679] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:27,391 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 03:00:27,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:27,391 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 03:00:27,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-05 03:00:27,394 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35405,1696474824903 with isa=jenkins-hbase4.apache.org/172.31.14.131:42403, startcode=1696474826248 2023-10-05 03:00:27,394 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35405,1696474824903 with isa=jenkins-hbase4.apache.org/172.31.14.131:39035, startcode=1696474826157 2023-10-05 03:00:27,394 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35405,1696474824903 with isa=jenkins-hbase4.apache.org/172.31.14.131:33679, startcode=1696474826205 2023-10-05 03:00:27,417 DEBUG [RS:2;jenkins-hbase4:42403] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 03:00:27,417 DEBUG [RS:1;jenkins-hbase4:33679] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 03:00:27,417 DEBUG [RS:0;jenkins-hbase4:39035] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 03:00:27,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-05 03:00:27,479 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58813, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 03:00:27,479 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56151, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 03:00:27,479 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51137, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 03:00:27,488 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35405] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 03:00:27,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 03:00:27,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 03:00:27,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 03:00:27,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 03:00:27,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-05 03:00:27,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 03:00:27,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696474857495 2023-10-05 03:00:27,497 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35405] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 03:00:27,498 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35405] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 03:00:27,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-05 03:00:27,502 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 03:00:27,503 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-05 03:00:27,509 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 03:00:27,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-05 03:00:27,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-05 03:00:27,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-05 03:00:27,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-05 03:00:27,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-05 03:00:27,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,522 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 03:00:27,522 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 03:00:27,523 WARN [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 03:00:27,522 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 03:00:27,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-05 03:00:27,523 WARN [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 03:00:27,523 WARN [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 03:00:27,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-05 03:00:27,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-05 03:00:27,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-05 03:00:27,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-05 03:00:27,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696474827535,5,FailOnTimeoutGroup] 2023-10-05 03:00:27,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696474827536,5,FailOnTimeoutGroup] 2023-10-05 03:00:27,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-05 03:00:27,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,557 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 03:00:27,558 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 03:00:27,559 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:27,582 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:27,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 03:00:27,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/info 2023-10-05 03:00:27,588 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 03:00:27,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:27,589 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 03:00:27,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/rep_barrier 2023-10-05 03:00:27,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 03:00:27,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:27,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 03:00:27,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/table 2023-10-05 03:00:27,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 03:00:27,596 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:27,598 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740 2023-10-05 03:00:27,599 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740 2023-10-05 03:00:27,603 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 03:00:27,605 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 03:00:27,610 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:27,611 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71778839, jitterRate=0.06958805024623871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 03:00:27,611 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 03:00:27,611 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 03:00:27,611 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 03:00:27,611 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 03:00:27,611 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 03:00:27,611 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 03:00:27,614 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 03:00:27,614 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 03:00:27,620 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 03:00:27,620 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-05 03:00:27,624 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35405,1696474824903 with isa=jenkins-hbase4.apache.org/172.31.14.131:33679, startcode=1696474826205 2023-10-05 03:00:27,624 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35405,1696474824903 with isa=jenkins-hbase4.apache.org/172.31.14.131:39035, startcode=1696474826157 2023-10-05 03:00:27,625 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,35405,1696474824903 with isa=jenkins-hbase4.apache.org/172.31.14.131:42403, startcode=1696474826248 2023-10-05 03:00:27,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-05 03:00:27,632 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35405] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,640 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35405] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,641 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35405] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,641 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:27,642 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34213 2023-10-05 03:00:27,642 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:27,642 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 03:00:27,642 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34213 2023-10-05 03:00:27,642 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 03:00:27,643 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:27,643 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34213 2023-10-05 03:00:27,643 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 03:00:27,647 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-05 03:00:27,653 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-05 03:00:27,654 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:00:27,655 DEBUG [RS:0;jenkins-hbase4:39035] zookeeper.ZKUtil(162): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,655 DEBUG [RS:1;jenkins-hbase4:33679] zookeeper.ZKUtil(162): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,656 WARN [RS:0;jenkins-hbase4:39035] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 03:00:27,656 WARN [RS:1;jenkins-hbase4:33679] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 03:00:27,656 INFO [RS:0;jenkins-hbase4:39035] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 03:00:27,655 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,657 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,657 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39035,1696474826157] 2023-10-05 03:00:27,657 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33679,1696474826205] 2023-10-05 03:00:27,657 WARN [RS:2;jenkins-hbase4:42403] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 03:00:27,656 INFO [RS:1;jenkins-hbase4:33679] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 03:00:27,658 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,658 INFO [RS:2;jenkins-hbase4:42403] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 03:00:27,657 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42403,1696474826248] 2023-10-05 03:00:27,659 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,671 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,671 DEBUG [RS:1;jenkins-hbase4:33679] zookeeper.ZKUtil(162): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,671 DEBUG [RS:0;jenkins-hbase4:39035] zookeeper.ZKUtil(162): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,672 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,672 DEBUG [RS:1;jenkins-hbase4:33679] zookeeper.ZKUtil(162): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,672 DEBUG [RS:0;jenkins-hbase4:39035] zookeeper.ZKUtil(162): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,672 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ZKUtil(162): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,673 DEBUG [RS:1;jenkins-hbase4:33679] zookeeper.ZKUtil(162): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,673 DEBUG [RS:0;jenkins-hbase4:39035] zookeeper.ZKUtil(162): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,684 DEBUG [RS:2;jenkins-hbase4:42403] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 03:00:27,684 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 03:00:27,684 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 03:00:27,694 INFO [RS:1;jenkins-hbase4:33679] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 03:00:27,695 INFO [RS:2;jenkins-hbase4:42403] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 03:00:27,694 INFO [RS:0;jenkins-hbase4:39035] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 03:00:27,717 INFO [RS:1;jenkins-hbase4:33679] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 03:00:27,717 INFO [RS:0;jenkins-hbase4:39035] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 03:00:27,717 INFO [RS:2;jenkins-hbase4:42403] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 03:00:27,722 INFO [RS:1;jenkins-hbase4:33679] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 03:00:27,722 INFO [RS:0;jenkins-hbase4:39035] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 03:00:27,722 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,722 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,722 INFO [RS:2;jenkins-hbase4:42403] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 03:00:27,723 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,723 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 03:00:27,724 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 03:00:27,724 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 03:00:27,733 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,733 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,733 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,733 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,733 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 03:00:27,734 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,734 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:1;jenkins-hbase4:33679] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:2;jenkins-hbase4:42403] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,735 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,736 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 03:00:27,736 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,736 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,736 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,736 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,737 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,737 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,737 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,737 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,737 DEBUG [RS:0;jenkins-hbase4:39035] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 03:00:27,737 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,741 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,741 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,741 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,757 INFO [RS:1;jenkins-hbase4:33679] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 03:00:27,758 INFO [RS:0;jenkins-hbase4:39035] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 03:00:27,758 INFO [RS:2;jenkins-hbase4:42403] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 03:00:27,761 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33679,1696474826205-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,761 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42403,1696474826248-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,761 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39035,1696474826157-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:27,783 INFO [RS:2;jenkins-hbase4:42403] regionserver.Replication(203): jenkins-hbase4.apache.org,42403,1696474826248 started 2023-10-05 03:00:27,783 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42403,1696474826248, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42403, sessionid=0x1011486b4b10003 2023-10-05 03:00:27,783 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 03:00:27,783 DEBUG [RS:2;jenkins-hbase4:42403] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,783 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42403,1696474826248' 2023-10-05 03:00:27,783 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 03:00:27,784 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 03:00:27,784 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 03:00:27,785 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 03:00:27,785 DEBUG [RS:2;jenkins-hbase4:42403] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:27,785 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42403,1696474826248' 2023-10-05 03:00:27,785 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:27,785 DEBUG [RS:2;jenkins-hbase4:42403] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:27,786 DEBUG [RS:2;jenkins-hbase4:42403] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 03:00:27,786 INFO [RS:2;jenkins-hbase4:42403] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 03:00:27,786 INFO [RS:2;jenkins-hbase4:42403] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 03:00:27,787 INFO [RS:0;jenkins-hbase4:39035] regionserver.Replication(203): jenkins-hbase4.apache.org,39035,1696474826157 started 2023-10-05 03:00:27,787 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39035,1696474826157, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39035, sessionid=0x1011486b4b10001 2023-10-05 03:00:27,787 INFO [RS:1;jenkins-hbase4:33679] regionserver.Replication(203): jenkins-hbase4.apache.org,33679,1696474826205 started 2023-10-05 03:00:27,787 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 03:00:27,787 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33679,1696474826205, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33679, sessionid=0x1011486b4b10002 2023-10-05 03:00:27,787 DEBUG [RS:0;jenkins-hbase4:39035] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,788 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 03:00:27,788 DEBUG [RS:0;jenkins-hbase4:39035] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39035,1696474826157' 2023-10-05 03:00:27,789 DEBUG [RS:1;jenkins-hbase4:33679] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,789 DEBUG [RS:1;jenkins-hbase4:33679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33679,1696474826205' 2023-10-05 03:00:27,789 DEBUG [RS:1;jenkins-hbase4:33679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 03:00:27,789 DEBUG [RS:0;jenkins-hbase4:39035] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 03:00:27,789 DEBUG [RS:0;jenkins-hbase4:39035] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 03:00:27,789 DEBUG [RS:1;jenkins-hbase4:33679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 03:00:27,790 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 03:00:27,790 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 03:00:27,790 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 03:00:27,790 DEBUG [RS:0;jenkins-hbase4:39035] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:27,791 DEBUG [RS:0;jenkins-hbase4:39035] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39035,1696474826157' 2023-10-05 03:00:27,791 DEBUG [RS:0;jenkins-hbase4:39035] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:27,791 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 03:00:27,791 DEBUG [RS:1;jenkins-hbase4:33679] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:27,791 DEBUG [RS:1;jenkins-hbase4:33679] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33679,1696474826205' 2023-10-05 03:00:27,791 DEBUG [RS:1;jenkins-hbase4:33679] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:27,791 DEBUG [RS:0;jenkins-hbase4:39035] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:27,791 DEBUG [RS:1;jenkins-hbase4:33679] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:27,792 DEBUG [RS:0;jenkins-hbase4:39035] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 03:00:27,792 INFO [RS:0;jenkins-hbase4:39035] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 03:00:27,792 DEBUG [RS:1;jenkins-hbase4:33679] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 03:00:27,792 INFO [RS:0;jenkins-hbase4:39035] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 03:00:27,792 INFO [RS:1;jenkins-hbase4:33679] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 03:00:27,793 INFO [RS:1;jenkins-hbase4:33679] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 03:00:27,805 DEBUG [jenkins-hbase4:35405] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-05 03:00:27,809 DEBUG [jenkins-hbase4:35405] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:00:27,815 DEBUG [jenkins-hbase4:35405] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:00:27,815 DEBUG [jenkins-hbase4:35405] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:00:27,815 DEBUG [jenkins-hbase4:35405] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:00:27,815 DEBUG [jenkins-hbase4:35405] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:00:27,818 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39035,1696474826157, state=OPENING 2023-10-05 03:00:27,826 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-05 03:00:27,828 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:27,828 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 03:00:27,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:00:27,897 INFO [RS:1;jenkins-hbase4:33679] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33679%2C1696474826205, suffix=, logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,33679,1696474826205, archiveDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs, maxLogs=32 2023-10-05 03:00:27,897 INFO [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42403%2C1696474826248, suffix=, logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,42403,1696474826248, archiveDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs, maxLogs=32 2023-10-05 03:00:27,897 INFO [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39035%2C1696474826157, suffix=, logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,39035,1696474826157, archiveDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs, maxLogs=32 2023-10-05 03:00:27,939 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK] 2023-10-05 03:00:27,939 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK] 2023-10-05 03:00:27,945 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK] 2023-10-05 03:00:27,950 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK] 2023-10-05 03:00:27,950 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK] 2023-10-05 03:00:27,950 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK] 2023-10-05 03:00:27,951 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK] 2023-10-05 03:00:27,951 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK] 2023-10-05 03:00:27,952 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK] 2023-10-05 03:00:27,966 INFO [RS:1;jenkins-hbase4:33679] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,33679,1696474826205/jenkins-hbase4.apache.org%2C33679%2C1696474826205.1696474827903 2023-10-05 03:00:27,967 INFO [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,39035,1696474826157/jenkins-hbase4.apache.org%2C39035%2C1696474826157.1696474827902 2023-10-05 03:00:27,969 DEBUG [RS:1;jenkins-hbase4:33679] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK], DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK], DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK]] 2023-10-05 03:00:27,970 INFO [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,42403,1696474826248/jenkins-hbase4.apache.org%2C42403%2C1696474826248.1696474827903 2023-10-05 03:00:27,973 DEBUG [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK], DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK], DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK]] 2023-10-05 03:00:27,973 DEBUG [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK], DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK], DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK]] 2023-10-05 03:00:28,026 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:28,030 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 03:00:28,033 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 03:00:28,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-05 03:00:28,049 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 03:00:28,053 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39035%2C1696474826157.meta, suffix=.meta, logDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,39035,1696474826157, archiveDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs, maxLogs=32 2023-10-05 03:00:28,079 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK] 2023-10-05 03:00:28,079 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK] 2023-10-05 03:00:28,080 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK] 2023-10-05 03:00:28,091 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/WALs/jenkins-hbase4.apache.org,39035,1696474826157/jenkins-hbase4.apache.org%2C39035%2C1696474826157.meta.1696474828055.meta 2023-10-05 03:00:28,091 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41117,DS-f369af2e-48cb-43ec-87e5-11b9dd3acef3,DISK], DatanodeInfoWithStorage[127.0.0.1:39499,DS-73649375-7b68-482e-8fec-38ef0f0bbf57,DISK], DatanodeInfoWithStorage[127.0.0.1:39385,DS-8ef9bd33-3f47-4fd1-9b42-59d1b5a13c19,DISK]] 2023-10-05 03:00:28,092 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-05 03:00:28,093 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-05 03:00:28,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:28,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-05 03:00:28,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-05 03:00:28,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-05 03:00:28,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-05 03:00:28,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:28,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-05 03:00:28,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-05 03:00:28,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 03:00:28,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/info 2023-10-05 03:00:28,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/info 2023-10-05 03:00:28,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 03:00:28,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:28,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 03:00:28,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/rep_barrier 2023-10-05 03:00:28,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/rep_barrier 2023-10-05 03:00:28,125 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 03:00:28,126 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:28,126 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 03:00:28,128 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/table 2023-10-05 03:00:28,128 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/table 2023-10-05 03:00:28,128 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 03:00:28,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:28,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740 2023-10-05 03:00:28,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740 2023-10-05 03:00:28,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 03:00:28,141 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 03:00:28,143 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75398631, jitterRate=0.1235271543264389}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 03:00:28,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 03:00:28,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696474828016 2023-10-05 03:00:28,182 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-05 03:00:28,183 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-05 03:00:28,183 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39035,1696474826157, state=OPEN 2023-10-05 03:00:28,187 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-05 03:00:28,187 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 03:00:28,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-05 03:00:28,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39035,1696474826157 in 354 msec 2023-10-05 03:00:28,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-05 03:00:28,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 562 msec 2023-10-05 03:00:28,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 802 msec 2023-10-05 03:00:28,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696474828206, completionTime=-1 2023-10-05 03:00:28,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-05 03:00:28,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-05 03:00:28,280 DEBUG [hconnection-0x18d0c61c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:28,283 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:28,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-05 03:00:28,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696474888312 2023-10-05 03:00:28,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696474948312 2023-10-05 03:00:28,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 105 msec 2023-10-05 03:00:28,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35405,1696474824903-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:28,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35405,1696474824903-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:28,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35405,1696474824903-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:28,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35405, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:28,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-05 03:00:28,347 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-05 03:00:28,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-05 03:00:28,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 03:00:28,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-05 03:00:28,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:00:28,371 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:00:28,393 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,396 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276 empty. 2023-10-05 03:00:28,397 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,397 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-05 03:00:28,435 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-05 03:00:28,438 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b2123a2b59a6c50d9bb9bb249a71276, NAME => 'hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:00:28,456 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:28,456 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4b2123a2b59a6c50d9bb9bb249a71276, disabling compactions & flushes 2023-10-05 03:00:28,457 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,457 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,457 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. after waiting 0 ms 2023-10-05 03:00:28,457 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,457 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,457 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4b2123a2b59a6c50d9bb9bb249a71276: 2023-10-05 03:00:28,462 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:00:28,477 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696474828465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474828465"}]},"ts":"1696474828465"} 2023-10-05 03:00:28,505 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 03:00:28,507 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:00:28,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474828507"}]},"ts":"1696474828507"} 2023-10-05 03:00:28,516 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-05 03:00:28,521 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:00:28,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:00:28,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:00:28,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:00:28,522 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:00:28,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4b2123a2b59a6c50d9bb9bb249a71276, ASSIGN}] 2023-10-05 03:00:28,528 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4b2123a2b59a6c50d9bb9bb249a71276, ASSIGN 2023-10-05 03:00:28,529 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4b2123a2b59a6c50d9bb9bb249a71276, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33679,1696474826205; forceNewPlan=false, retain=false 2023-10-05 03:00:28,682 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 03:00:28,683 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4b2123a2b59a6c50d9bb9bb249a71276, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:28,683 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696474828683"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474828683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474828683"}]},"ts":"1696474828683"} 2023-10-05 03:00:28,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4b2123a2b59a6c50d9bb9bb249a71276, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:00:28,842 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:28,842 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 03:00:28,845 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 03:00:28,854 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,854 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b2123a2b59a6c50d9bb9bb249a71276, NAME => 'hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.', STARTKEY => '', ENDKEY => ''} 2023-10-05 03:00:28,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. service=AccessControlService 2023-10-05 03:00:28,856 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:28,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:28,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,860 INFO [StoreOpener-4b2123a2b59a6c50d9bb9bb249a71276-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,862 DEBUG [StoreOpener-4b2123a2b59a6c50d9bb9bb249a71276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/info 2023-10-05 03:00:28,862 DEBUG [StoreOpener-4b2123a2b59a6c50d9bb9bb249a71276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/info 2023-10-05 03:00:28,863 INFO [StoreOpener-4b2123a2b59a6c50d9bb9bb249a71276-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b2123a2b59a6c50d9bb9bb249a71276 columnFamilyName info 2023-10-05 03:00:28,864 INFO [StoreOpener-4b2123a2b59a6c50d9bb9bb249a71276-1] regionserver.HStore(310): Store=4b2123a2b59a6c50d9bb9bb249a71276/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:28,866 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,867 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,872 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:00:28,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:28,878 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b2123a2b59a6c50d9bb9bb249a71276; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73359945, jitterRate=0.0931483656167984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:28,878 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b2123a2b59a6c50d9bb9bb249a71276: 2023-10-05 03:00:28,880 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276., pid=6, masterSystemTime=1696474828842 2023-10-05 03:00:28,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,886 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:00:28,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4b2123a2b59a6c50d9bb9bb249a71276, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:28,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696474828887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474828887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474828887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474828887"}]},"ts":"1696474828887"} 2023-10-05 03:00:28,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-05 03:00:28,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4b2123a2b59a6c50d9bb9bb249a71276, server=jenkins-hbase4.apache.org,33679,1696474826205 in 203 msec 2023-10-05 03:00:28,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-05 03:00:28,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4b2123a2b59a6c50d9bb9bb249a71276, ASSIGN in 370 msec 2023-10-05 03:00:28,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:00:28,901 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474828901"}]},"ts":"1696474828901"} 2023-10-05 03:00:28,903 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-05 03:00:28,907 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:00:28,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 550 msec 2023-10-05 03:00:28,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-05 03:00:28,973 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-05 03:00:28,973 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:28,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:28,999 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:29,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-05 03:00:29,033 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 03:00:29,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-10-05 03:00:29,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-05 03:00:29,060 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 03:00:29,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-05 03:00:29,074 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-05 03:00:29,078 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-05 03:00:29,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.761sec 2023-10-05 03:00:29,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-05 03:00:29,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-05 03:00:29,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-05 03:00:29,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35405,1696474824903-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-05 03:00:29,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35405,1696474824903-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-05 03:00:29,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 03:00:29,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-05 03:00:29,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:00:29,112 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:00:29,116 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-05 03:00:29,117 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38 empty. 2023-10-05 03:00:29,120 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,120 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-05 03:00:29,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 03:00:29,143 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-05 03:00:29,145 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc299273bf6d63c8a0cebc83d19f4f38, NAME => 'hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:00:29,165 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:29,165 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing dc299273bf6d63c8a0cebc83d19f4f38, disabling compactions & flushes 2023-10-05 03:00:29,165 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,165 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,165 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. after waiting 0 ms 2023-10-05 03:00:29,165 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,165 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,165 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for dc299273bf6d63c8a0cebc83d19f4f38: 2023-10-05 03:00:29,170 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:00:29,172 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696474829171"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474829171"}]},"ts":"1696474829171"} 2023-10-05 03:00:29,175 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 03:00:29,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:00:29,177 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474829176"}]},"ts":"1696474829176"} 2023-10-05 03:00:29,179 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-05 03:00:29,184 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:00:29,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:00:29,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:00:29,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:00:29,185 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:00:29,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dc299273bf6d63c8a0cebc83d19f4f38, ASSIGN}] 2023-10-05 03:00:29,188 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=dc299273bf6d63c8a0cebc83d19f4f38, ASSIGN 2023-10-05 03:00:29,190 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=dc299273bf6d63c8a0cebc83d19f4f38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39035,1696474826157; forceNewPlan=false, retain=false 2023-10-05 03:00:29,191 DEBUG [Listener at localhost/41459] zookeeper.ReadOnlyZKClient(139): Connect 0x4170740d to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:29,195 DEBUG [Listener at localhost/41459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5664efd5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:29,209 DEBUG [hconnection-0x775c4869-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:29,221 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:29,223 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:00:29,223 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/test.cache.data in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop.log.dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 03:00:29,224 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/nfs.dump.dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 03:00:29,225 INFO [Listener at localhost/41459] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-05 03:00:29,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 03:00:29,340 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 03:00:29,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dc299273bf6d63c8a0cebc83d19f4f38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:29,342 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696474829341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474829341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474829341"}]},"ts":"1696474829341"} 2023-10-05 03:00:29,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure dc299273bf6d63c8a0cebc83d19f4f38, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:00:29,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 03:00:29,509 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc299273bf6d63c8a0cebc83d19f4f38, NAME => 'hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.', STARTKEY => '', ENDKEY => ''} 2023-10-05 03:00:29,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. service=AccessControlService 2023-10-05 03:00:29,510 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:29,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:29,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,513 INFO [StoreOpener-dc299273bf6d63c8a0cebc83d19f4f38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,515 DEBUG [StoreOpener-dc299273bf6d63c8a0cebc83d19f4f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/l 2023-10-05 03:00:29,515 DEBUG [StoreOpener-dc299273bf6d63c8a0cebc83d19f4f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/l 2023-10-05 03:00:29,516 INFO [StoreOpener-dc299273bf6d63c8a0cebc83d19f4f38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc299273bf6d63c8a0cebc83d19f4f38 columnFamilyName l 2023-10-05 03:00:29,517 INFO [StoreOpener-dc299273bf6d63c8a0cebc83d19f4f38-1] regionserver.HStore(310): Store=dc299273bf6d63c8a0cebc83d19f4f38/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:29,520 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,521 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:00:29,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:29,532 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc299273bf6d63c8a0cebc83d19f4f38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70560196, jitterRate=0.05142885446548462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:29,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc299273bf6d63c8a0cebc83d19f4f38: 2023-10-05 03:00:29,534 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38., pid=11, masterSystemTime=1696474829500 2023-10-05 03:00:29,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,537 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:00:29,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=dc299273bf6d63c8a0cebc83d19f4f38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:29,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696474829539"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474829539"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474829539"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474829539"}]},"ts":"1696474829539"} 2023-10-05 03:00:29,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-05 03:00:29,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure dc299273bf6d63c8a0cebc83d19f4f38, server=jenkins-hbase4.apache.org,39035,1696474826157 in 197 msec 2023-10-05 03:00:29,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-05 03:00:29,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=dc299273bf6d63c8a0cebc83d19f4f38, ASSIGN in 360 msec 2023-10-05 03:00:29,554 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:00:29,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474829554"}]},"ts":"1696474829554"} 2023-10-05 03:00:29,557 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-05 03:00:29,561 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:00:29,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 455 msec 2023-10-05 03:00:29,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 03:00:29,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-05 03:00:29,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-05 03:00:30,467 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:30,834 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:30,841 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46751_jobhistory____mtoxq2/webapp 2023-10-05 03:00:31,014 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-05 03:00:31,015 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-05 03:00:31,015 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 03:00:31,018 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 03:00:31,108 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:31,434 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:31,739 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-05 03:00:31,767 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46751 2023-10-05 03:00:31,964 WARN [Listener at jenkins-hbase4.apache.org/37835] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:32,265 WARN [Listener at jenkins-hbase4.apache.org/37835] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 03:00:32,266 INFO [Listener at jenkins-hbase4.apache.org/37835] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:32,273 INFO [Listener at jenkins-hbase4.apache.org/37835] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41935_cluster____.gbq3tm/webapp 2023-10-05 03:00:32,345 INFO [Listener at jenkins-hbase4.apache.org/37835] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 03:00:32,345 INFO [Listener at jenkins-hbase4.apache.org/37835] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-05 03:00:32,346 INFO [Listener at jenkins-hbase4.apache.org/37835] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 03:00:32,346 INFO [Listener at jenkins-hbase4.apache.org/37835] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 03:00:32,356 INFO [Listener at jenkins-hbase4.apache.org/37835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:32,538 INFO [Listener at jenkins-hbase4.apache.org/37835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:32,620 INFO [Listener at jenkins-hbase4.apache.org/37835] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:32,627 INFO [Listener at jenkins-hbase4.apache.org/37835] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41935 2023-10-05 03:00:33,097 WARN [Listener at jenkins-hbase4.apache.org/42813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:33,127 WARN [Listener at jenkins-hbase4.apache.org/42813] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 03:00:33,127 INFO [Listener at jenkins-hbase4.apache.org/42813] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:33,149 INFO [Listener at jenkins-hbase4.apache.org/42813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41771_node____1ejs36/webapp 2023-10-05 03:00:33,216 INFO [Listener at jenkins-hbase4.apache.org/42813] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 03:00:33,216 INFO [Listener at jenkins-hbase4.apache.org/42813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 03:00:33,217 INFO [Listener at jenkins-hbase4.apache.org/42813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 03:00:33,217 INFO [Listener at jenkins-hbase4.apache.org/42813] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 03:00:33,225 INFO [Listener at jenkins-hbase4.apache.org/42813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:33,246 INFO [Listener at jenkins-hbase4.apache.org/42813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:33,311 INFO [Listener at jenkins-hbase4.apache.org/42813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:33,321 INFO [Listener at jenkins-hbase4.apache.org/42813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41771 2023-10-05 03:00:33,488 WARN [Listener at jenkins-hbase4.apache.org/40081] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 03:00:33,497 WARN [Listener at jenkins-hbase4.apache.org/40081] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 03:00:33,498 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 03:00:33,505 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35515_node____.pu3akr/webapp 2023-10-05 03:00:33,557 INFO [Listener at jenkins-hbase4.apache.org/40081] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 03:00:33,557 INFO [Listener at jenkins-hbase4.apache.org/40081] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 03:00:33,557 INFO [Listener at jenkins-hbase4.apache.org/40081] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 03:00:33,557 INFO [Listener at jenkins-hbase4.apache.org/40081] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 03:00:33,565 INFO [Listener at jenkins-hbase4.apache.org/40081] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:33,582 INFO [Listener at jenkins-hbase4.apache.org/40081] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:33,642 INFO [Listener at jenkins-hbase4.apache.org/40081] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 03:00:33,648 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35515 2023-10-05 03:00:33,676 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:00:33,679 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-05 03:00:33,681 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:00:33,775 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=300, ProcessCount=165, AvailableMemoryMB=6835 2023-10-05 03:00:33,776 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-10-05 03:00:33,801 DEBUG [Listener at jenkins-hbase4.apache.org/40081] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-05 03:00:33,807 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-05 03:00:33,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 03:00:33,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:33,837 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:00:33,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-05 03:00:33,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 03:00:33,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:00:33,858 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:33,858 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:33,861 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e empty. 2023-10-05 03:00:33,862 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 empty. 2023-10-05 03:00:33,867 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:33,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:33,869 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 03:00:33,915 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-05 03:00:33,920 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 406297cd6072b7c0ec3c5e866f86ad23, NAME => 'testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:00:33,920 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 663915b337dfa2caffea76fd0467b26e, NAME => 'testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:00:33,921 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-05 03:00:33,926 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-05 03:00:33,928 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-05 03:00:33,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 03:00:33,964 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 663915b337dfa2caffea76fd0467b26e, disabling compactions & flushes 2023-10-05 03:00:33,965 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. after waiting 0 ms 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:33,965 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 406297cd6072b7c0ec3c5e866f86ad23, disabling compactions & flushes 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 663915b337dfa2caffea76fd0467b26e: 2023-10-05 03:00:33,965 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:33,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:33,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. after waiting 0 ms 2023-10-05 03:00:33,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:33,966 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:33,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 406297cd6072b7c0ec3c5e866f86ad23: 2023-10-05 03:00:33,972 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:00:33,974 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474833973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474833973"}]},"ts":"1696474833973"} 2023-10-05 03:00:33,974 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474833973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474833973"}]},"ts":"1696474833973"} 2023-10-05 03:00:34,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:00:34,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:00:34,025 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474834025"}]},"ts":"1696474834025"} 2023-10-05 03:00:34,027 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-05 03:00:34,032 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:00:34,035 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:00:34,035 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:00:34,035 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:00:34,035 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:00:34,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, ASSIGN}] 2023-10-05 03:00:34,039 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, ASSIGN 2023-10-05 03:00:34,039 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, ASSIGN 2023-10-05 03:00:34,040 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39035,1696474826157; forceNewPlan=false, retain=false 2023-10-05 03:00:34,040 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33679,1696474826205; forceNewPlan=false, retain=false 2023-10-05 03:00:34,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 03:00:34,190 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:00:34,193 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=406297cd6072b7c0ec3c5e866f86ad23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:34,193 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=663915b337dfa2caffea76fd0467b26e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:34,193 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474834193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474834193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474834193"}]},"ts":"1696474834193"} 2023-10-05 03:00:34,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474834193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474834193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474834193"}]},"ts":"1696474834193"} 2023-10-05 03:00:34,196 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 663915b337dfa2caffea76fd0467b26e, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:00:34,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 406297cd6072b7c0ec3c5e866f86ad23, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:00:34,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:34,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 663915b337dfa2caffea76fd0467b26e, NAME => 'testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 03:00:34,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. service=AccessControlService 2023-10-05 03:00:34,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:34,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:34,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 406297cd6072b7c0ec3c5e866f86ad23, NAME => 'testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 03:00:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. service=AccessControlService 2023-10-05 03:00:34,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,369 INFO [StoreOpener-663915b337dfa2caffea76fd0467b26e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,369 INFO [StoreOpener-406297cd6072b7c0ec3c5e866f86ad23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,372 DEBUG [StoreOpener-406297cd6072b7c0ec3c5e866f86ad23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf 2023-10-05 03:00:34,372 DEBUG [StoreOpener-406297cd6072b7c0ec3c5e866f86ad23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf 2023-10-05 03:00:34,373 DEBUG [StoreOpener-663915b337dfa2caffea76fd0467b26e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf 2023-10-05 03:00:34,373 DEBUG [StoreOpener-663915b337dfa2caffea76fd0467b26e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf 2023-10-05 03:00:34,376 INFO [StoreOpener-406297cd6072b7c0ec3c5e866f86ad23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 406297cd6072b7c0ec3c5e866f86ad23 columnFamilyName cf 2023-10-05 03:00:34,376 INFO [StoreOpener-663915b337dfa2caffea76fd0467b26e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 663915b337dfa2caffea76fd0467b26e columnFamilyName cf 2023-10-05 03:00:34,379 INFO [StoreOpener-663915b337dfa2caffea76fd0467b26e-1] regionserver.HStore(310): Store=663915b337dfa2caffea76fd0467b26e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:34,379 INFO [StoreOpener-406297cd6072b7c0ec3c5e866f86ad23-1] regionserver.HStore(310): Store=406297cd6072b7c0ec3c5e866f86ad23/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:34,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:34,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:34,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:34,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:34,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 406297cd6072b7c0ec3c5e866f86ad23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72172179, jitterRate=0.07544927299022675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:34,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 663915b337dfa2caffea76fd0467b26e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67115139, jitterRate=9.350478649139404E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:34,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 406297cd6072b7c0ec3c5e866f86ad23: 2023-10-05 03:00:34,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 663915b337dfa2caffea76fd0467b26e: 2023-10-05 03:00:34,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23., pid=16, masterSystemTime=1696474834350 2023-10-05 03:00:34,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e., pid=15, masterSystemTime=1696474834349 2023-10-05 03:00:34,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:34,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:34,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=406297cd6072b7c0ec3c5e866f86ad23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:34,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474834409"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474834409"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474834409"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474834409"}]},"ts":"1696474834409"} 2023-10-05 03:00:34,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:34,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:34,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=663915b337dfa2caffea76fd0467b26e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:34,412 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474834410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474834410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474834410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474834410"}]},"ts":"1696474834410"} 2023-10-05 03:00:34,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-05 03:00:34,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 406297cd6072b7c0ec3c5e866f86ad23, server=jenkins-hbase4.apache.org,39035,1696474826157 in 216 msec 2023-10-05 03:00:34,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-05 03:00:34,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 663915b337dfa2caffea76fd0467b26e, server=jenkins-hbase4.apache.org,33679,1696474826205 in 220 msec 2023-10-05 03:00:34,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, ASSIGN in 383 msec 2023-10-05 03:00:34,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-05 03:00:34,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, ASSIGN in 386 msec 2023-10-05 03:00:34,425 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:00:34,426 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474834426"}]},"ts":"1696474834426"} 2023-10-05 03:00:34,428 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-05 03:00:34,433 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:00:34,439 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-05 03:00:34,457 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 03:00:34,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 03:00:34,489 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:34,489 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:34,489 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:34,489 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:34,489 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:00:34,499 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:34,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:34,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:34,499 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:34,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:34,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:34,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 678 msec 2023-10-05 03:00:34,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 03:00:34,967 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-05 03:00:34,972 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 03:00:34,973 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:34,975 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:00:35,002 DEBUG [hconnection-0x775c4869-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:35,006 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:35,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 03:00:35,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474835031 (current time:1696474835031). 2023-10-05 03:00:35,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:00:35,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x2d96d4d9 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:35,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12813b6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:35,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:35,045 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:35,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d96d4d9 to 127.0.0.1:56535 2023-10-05 03:00:35,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:35,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x2b702c17 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:35,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a2cda4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:35,058 DEBUG [hconnection-0x6857c244-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:35,060 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:35,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b702c17 to 127.0.0.1:56535 2023-10-05 03:00:35,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:35,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 03:00:35,078 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:00:35,078 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-05 03:00:35,078 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:00:35,078 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-05 03:00:35,079 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 03:00:35,079 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-05 03:00:35,079 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:00:35,079 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-05 03:00:35,079 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 03:00:35,079 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-05 03:00:35,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:00:35,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 03:00:35,111 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:00:35,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 03:00:35,134 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 03:00:35,136 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696475435136 2023-10-05 03:00:35,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 03:00:35,136 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 03:00:35,139 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 03:00:35,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 03:00:35,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-05 03:00:35,142 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 03:00:35,143 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696475435143 2023-10-05 03:00:35,144 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:00:35,144 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:00:35,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,171 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-05 03:00:35,171 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:35,172 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 03:00:35,172 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 03:00:35,172 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,173 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:35,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:35,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:35,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:35,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:35,178 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:35,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,179 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,179 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,180 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,180 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 03:00:35,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 03:00:35,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 03:00:35,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 03:00:35,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,185 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 03:00:35,185 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 03:00:35,185 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:35,185 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:35,186 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 03:00:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 03:00:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 03:00:35,185 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 03:00:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 03:00:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 03:00:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:35,187 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 03:00:35,188 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 03:00:35,188 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 03:00:35,188 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 03:00:35,191 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,191 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,191 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:35,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:35,192 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:35,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:35,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:35,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:35,193 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,193 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:35,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:35,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 03:00:35,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d0bf2b5[Count = 1] remaining members to acquire global barrier 2023-10-05 03:00:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:35,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:35,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 03:00:35,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d0bf2b5[Count = 0] remaining members to acquire global barrier 2023-10-05 03:00:35,198 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 03:00:35,198 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 03:00:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 03:00:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:00:35,201 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,201 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 03:00:35,202 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,202 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:00:35,202 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 03:00:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:35,203 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:35,203 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:35,203 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. started... 2023-10-05 03:00:35,205 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:35,206 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:35,206 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 03:00:35,206 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. started... 2023-10-05 03:00:35,206 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:35,206 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:35,206 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 03:00:35,208 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 663915b337dfa2caffea76fd0467b26e: 2023-10-05 03:00:35,208 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 406297cd6072b7c0ec3c5e866f86ad23: 2023-10-05 03:00:35,209 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,209 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,215 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:35,215 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:35,219 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:00:35,219 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:00:35,244 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:35,257 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. completed. 2023-10-05 03:00:35,258 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 03:00:35,258 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:00:35,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:35,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:35,261 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:00:35,261 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,261 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 03:00:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 03:00:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:00:35,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 03:00:35,461 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:35,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:35,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:35,463 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 03:00:35,661 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. completed. 2023-10-05 03:00:35,661 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 03:00:35,661 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:00:35,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,663 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 03:00:35,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:35,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:35,663 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:35,664 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 03:00:35,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:35,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:35,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:35,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33679,1696474826205': 2023-10-05 03:00:35,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 03:00:35,669 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-05 03:00:35,669 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:00:35,669 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:00:35,669 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,669 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:00:35,672 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:35,672 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:35,672 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,673 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:35,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:35,673 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:35,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:35,674 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:35,675 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:35,677 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,678 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,678 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:35,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:35,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:35,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:35,692 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:35,694 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 03:00:35,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:35,692 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:35,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:35,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:35,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:00:35,694 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:35,694 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:35,694 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:35,694 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:35,695 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:35,695 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,695 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:35,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:35,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 03:00:35,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,763 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:35,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:35,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:35,765 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-05 03:00:35,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 03:00:35,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,776 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:35,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696474835136Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696474835721 (+585 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696474835721Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696474835722 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696474835734 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696474835761 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696474835775 (+14 ms) 2023-10-05 03:00:35,779 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 03:00:35,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 641 msec 2023-10-05 03:00:36,265 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:36,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:36,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:00:36,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39035] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:00:36,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33679] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:00:36,292 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 03:00:36,292 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:36,292 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:00:36,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 03:00:36,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474836306 (current time:1696474836306). 2023-10-05 03:00:36,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:00:36,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3987fe to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:36,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a006f09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:36,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:36,318 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:36,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3987fe to 127.0.0.1:56535 2023-10-05 03:00:36,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:36,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x2089f8bb to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:36,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@230c8d23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:36,327 DEBUG [hconnection-0x7aadc66c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:36,329 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:36,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2089f8bb to 127.0.0.1:56535 2023-10-05 03:00:36,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:36,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 03:00:36,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:00:36,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 03:00:36,338 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:00:36,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 03:00:36,341 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 03:00:36,342 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696475436342 2023-10-05 03:00:36,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 03:00:36,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 03:00:36,343 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:00:36,343 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:00:36,344 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 03:00:36,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 03:00:36,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-10-05 03:00:36,347 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 03:00:36,348 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696475436348 2023-10-05 03:00:36,443 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:36,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:36,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:36,445 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:00:36,645 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:36,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:36,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:36,647 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 03:00:36,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-05 03:00:36,767 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-05 03:00:36,767 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:36,767 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 03:00:36,767 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 03:00:36,768 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,768 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,771 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:36,771 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:36,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:36,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:36,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:36,771 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,771 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:36,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:36,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:36,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:36,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,772 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,772 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,772 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,772 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 03:00:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,773 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:36,773 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 03:00:36,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 03:00:36,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 03:00:36,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:36,775 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:36,776 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 03:00:36,777 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 03:00:36,777 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 03:00:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 03:00:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 03:00:36,778 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 03:00:36,779 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:36,780 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,780 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,781 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:36,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:36,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 03:00:36,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@613805c0[Count = 1] remaining members to acquire global barrier 2023-10-05 03:00:36,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:36,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:36,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 03:00:36,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@613805c0[Count = 0] remaining members to acquire global barrier 2023-10-05 03:00:36,786 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 03:00:36,786 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 03:00:36,794 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:36,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:36,794 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:00:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:36,794 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. started... 2023-10-05 03:00:36,794 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:36,794 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:00:36,794 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 03:00:36,794 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 663915b337dfa2caffea76fd0467b26e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 03:00:36,795 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:36,795 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:36,795 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:36,795 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. started... 2023-10-05 03:00:36,795 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 406297cd6072b7c0ec3c5e866f86ad23 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 03:00:36,797 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 03:00:36,797 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:36,797 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 03:00:36,924 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310059612ec56d8ab403fb15933cb5f5b6e8f to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310059612ec56d8ab403fb15933cb5f5b6e8f 2023-10-05 03:00:36,924 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310051ede9a30079743de8ae5588e7d598cac to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310051ede9a30079743de8ae5588e7d598cac 2023-10-05 03:00:36,948 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:36,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:36,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:36,958 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-05 03:00:36,963 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/.tmp/cf/c7086c33c6834c529ae0b323db16837b 2023-10-05 03:00:36,963 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/.tmp/cf/ae26afa719744bb5a2551550da320821 2023-10-05 03:00:36,975 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/.tmp/cf/ae26afa719744bb5a2551550da320821 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf/ae26afa719744bb5a2551550da320821 2023-10-05 03:00:36,976 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/.tmp/cf/c7086c33c6834c529ae0b323db16837b as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf/c7086c33c6834c529ae0b323db16837b 2023-10-05 03:00:36,984 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf/ae26afa719744bb5a2551550da320821, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 03:00:36,986 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf/c7086c33c6834c529ae0b323db16837b, entries=47, sequenceid=6, filesize=12.8 K 2023-10-05 03:00:36,989 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 406297cd6072b7c0ec3c5e866f86ad23 in 194ms, sequenceid=6, compaction requested=false 2023-10-05 03:00:36,989 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 663915b337dfa2caffea76fd0467b26e in 195ms, sequenceid=6, compaction requested=false 2023-10-05 03:00:36,990 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 03:00:36,990 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 03:00:36,992 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 663915b337dfa2caffea76fd0467b26e: 2023-10-05 03:00:36,992 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 406297cd6072b7c0ec3c5e866f86ad23: 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf/c7086c33c6834c529ae0b323db16837b] hfiles 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf/ae26afa719744bb5a2551550da320821] hfiles 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf/c7086c33c6834c529ae0b323db16837b for snapshot=snaptb0-testExportWithTargetName 2023-10-05 03:00:36,993 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf/ae26afa719744bb5a2551550da320821 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 03:00:37,021 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. completed. 2023-10-05 03:00:37,021 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:37,021 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:37,021 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:37,021 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,021 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 03:00:37,021 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:00:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 03:00:37,023 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:37,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:37,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:37,023 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 03:00:37,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:37,025 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. completed. 2023-10-05 03:00:37,025 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:37,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:37,025 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:37,026 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:37,026 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,026 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 03:00:37,026 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:00:37,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,028 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,028 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 03:00:37,029 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:37,029 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 03:00:37,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33679,1696474826205': 2023-10-05 03:00:37,032 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 03:00:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:37,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:00:37,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 03:00:37,037 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-05 03:00:37,037 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:00:37,037 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:00:37,037 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-05 03:00:37,037 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:00:37,039 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:37,039 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,040 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:37,039 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:37,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,039 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:37,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:37,040 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:37,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,041 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:37,042 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:37,044 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 03:00:37,044 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,045 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,058 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:37,058 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:37,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:37,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:37,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:37,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:37,058 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:37,058 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:37,058 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:37,058 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:37,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:37,059 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:37,059 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:37,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-05 03:00:37,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:37,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:37,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:37,059 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:37,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 03:00:37,060 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:37,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,061 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310059612ec56d8ab403fb15933cb5f5b6e8f, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310051ede9a30079743de8ae5588e7d598cac] mob files 2023-10-05 03:00:37,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310059612ec56d8ab403fb15933cb5f5b6e8f 2023-10-05 03:00:37,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310051ede9a30079743de8ae5588e7d598cac 2023-10-05 03:00:37,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-05 03:00:37,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 03:00:37,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,123 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 03:00:37,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696474836342Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696474837078 (+736 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696474837078Loading Region manifests for snaptb0-testExportWithTargetName at 1696474837078Writing data manifest for snaptb0-testExportWithTargetName at 1696474837084 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696474837109 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696474837122 (+13 ms) 2023-10-05 03:00:37,125 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 03:00:37,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 783 msec 2023-10-05 03:00:37,458 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 03:00:37,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:00:37,461 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461 2023-10-05 03:00:37,462 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34213, tgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461, rawTgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:37,501 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:37,501 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1368777029_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 03:00:37,501 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-05 03:00:37,520 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 03:00:37,580 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:37,581 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:37,581 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:37,582 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,487 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-5122152627206474031.jar 2023-10-05 03:00:38,488 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,488 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,555 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-1762531650519605343.jar 2023-10-05 03:00:38,556 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,556 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,557 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,557 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,558 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,558 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:38,559 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:00:38,559 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:00:38,560 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:00:38,561 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:00:38,561 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:00:38,562 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:00:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:00:38,563 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:00:38,564 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:00:38,565 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:00:38,570 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:38,571 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:38,571 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:00:38,572 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:38,572 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:38,573 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:00:38,574 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:00:39,423 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:00:39,429 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-05 03:00:39,438 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 03:00:39,870 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:00:39,893 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:00:39,894 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:00:40,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0001_000001 (auth:SIMPLE) 2023-10-05 03:00:45,236 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0001_000001 (auth:SIMPLE) 2023-10-05 03:00:47,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0001_000001 (auth:SIMPLE) 2023-10-05 03:00:50,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0001_000001 (auth:SIMPLE) 2023-10-05 03:00:52,279 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:00:52,283 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:00:52,294 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-05 03:00:52,294 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:00:52,295 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:00:52,295 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 03:00:52,295 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-05 03:00:52,296 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-05 03:00:52,296 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461/.hbase-snapshot/testExportWithTargetName 2023-10-05 03:00:52,296 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-05 03:00:52,296 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474837461/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-05 03:00:52,308 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-05 03:00:52,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-05 03:00:52,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,327 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474852326"}]},"ts":"1696474852326"} 2023-10-05 03:00:52,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 03:00:52,329 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-05 03:00:52,331 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-05 03:00:52,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, UNASSIGN}] 2023-10-05 03:00:52,335 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, UNASSIGN 2023-10-05 03:00:52,335 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, UNASSIGN 2023-10-05 03:00:52,336 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=406297cd6072b7c0ec3c5e866f86ad23, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:52,336 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=663915b337dfa2caffea76fd0467b26e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:52,336 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474852336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474852336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474852336"}]},"ts":"1696474852336"} 2023-10-05 03:00:52,336 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474852336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474852336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474852336"}]},"ts":"1696474852336"} 2023-10-05 03:00:52,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 406297cd6072b7c0ec3c5e866f86ad23, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:00:52,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 663915b337dfa2caffea76fd0467b26e, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:00:52,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 03:00:52,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:52,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 663915b337dfa2caffea76fd0467b26e, disabling compactions & flushes 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 406297cd6072b7c0ec3c5e866f86ad23, disabling compactions & flushes 2023-10-05 03:00:52,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:52,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. after waiting 0 ms 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. after waiting 0 ms 2023-10-05 03:00:52,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:52,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:00:52,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:00:52,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:00:52,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:00:52,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e. 2023-10-05 03:00:52,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23. 2023-10-05 03:00:52,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 663915b337dfa2caffea76fd0467b26e: 2023-10-05 03:00:52,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 406297cd6072b7c0ec3c5e866f86ad23: 2023-10-05 03:00:52,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:52,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=406297cd6072b7c0ec3c5e866f86ad23, regionState=CLOSED 2023-10-05 03:00:52,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474852522"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474852522"}]},"ts":"1696474852522"} 2023-10-05 03:00:52,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:52,524 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=663915b337dfa2caffea76fd0467b26e, regionState=CLOSED 2023-10-05 03:00:52,524 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696474852524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474852524"}]},"ts":"1696474852524"} 2023-10-05 03:00:52,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-05 03:00:52,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 406297cd6072b7c0ec3c5e866f86ad23, server=jenkins-hbase4.apache.org,39035,1696474826157 in 186 msec 2023-10-05 03:00:52,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-05 03:00:52,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=406297cd6072b7c0ec3c5e866f86ad23, UNASSIGN in 195 msec 2023-10-05 03:00:52,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 663915b337dfa2caffea76fd0467b26e, server=jenkins-hbase4.apache.org,33679,1696474826205 in 186 msec 2023-10-05 03:00:52,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-10-05 03:00:52,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=663915b337dfa2caffea76fd0467b26e, UNASSIGN in 197 msec 2023-10-05 03:00:52,534 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474852534"}]},"ts":"1696474852534"} 2023-10-05 03:00:52,536 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-05 03:00:52,538 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-05 03:00:52,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-10-05 03:00:52,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 03:00:52,631 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-05 03:00:52,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-05 03:00:52,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,648 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-05 03:00:52,650 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,653 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-05 03:00:52,656 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:52,656 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:52,659 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/recovered.edits] 2023-10-05 03:00:52,659 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/recovered.edits] 2023-10-05 03:00:52,661 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,661 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,661 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,661 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 03:00:52,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 03:00:52,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 03:00:52,662 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-05 03:00:52,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:52,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:52,664 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 03:00:52,663 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:52,664 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:52,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 03:00:52,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf/c7086c33c6834c529ae0b323db16837b to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/cf/c7086c33c6834c529ae0b323db16837b 2023-10-05 03:00:52,672 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf/ae26afa719744bb5a2551550da320821 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/cf/ae26afa719744bb5a2551550da320821 2023-10-05 03:00:52,676 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e/recovered.edits/9.seqid 2023-10-05 03:00:52,677 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23/recovered.edits/9.seqid 2023-10-05 03:00:52,677 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/663915b337dfa2caffea76fd0467b26e 2023-10-05 03:00:52,677 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportWithTargetName/406297cd6072b7c0ec3c5e866f86ad23 2023-10-05 03:00:52,677 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 03:00:52,678 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 03:00:52,679 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-05 03:00:52,683 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310059612ec56d8ab403fb15933cb5f5b6e8f to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310059612ec56d8ab403fb15933cb5f5b6e8f 2023-10-05 03:00:52,685 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310051ede9a30079743de8ae5588e7d598cac to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202310051ede9a30079743de8ae5588e7d598cac 2023-10-05 03:00:52,685 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 03:00:52,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,712 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-05 03:00:52,715 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-05 03:00:52,717 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,717 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-05 03:00:52,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474852717"}]},"ts":"9223372036854775807"} 2023-10-05 03:00:52,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474852717"}]},"ts":"9223372036854775807"} 2023-10-05 03:00:52,719 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 03:00:52,719 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 406297cd6072b7c0ec3c5e866f86ad23, NAME => 'testtb-testExportWithTargetName,,1696474833820.406297cd6072b7c0ec3c5e866f86ad23.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 663915b337dfa2caffea76fd0467b26e, NAME => 'testtb-testExportWithTargetName,1,1696474833820.663915b337dfa2caffea76fd0467b26e.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 03:00:52,719 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-05 03:00:52,720 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474852720"}]},"ts":"9223372036854775807"} 2023-10-05 03:00:52,722 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-05 03:00:52,725 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 03:00:52,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 87 msec 2023-10-05 03:00:52,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 03:00:52,774 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-05 03:00:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-05 03:00:52,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-05 03:00:52,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-05 03:00:52,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-05 03:00:52,834 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 709) Potentially hanging thread: (jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1287 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:42284 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_824872114_1 at /127.0.0.1:52262 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:41225 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:37084 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_824872114_1 at /127.0.0.1:42266 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:52272 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:38875 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=310 (was 300) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=6063 (was 6835) 2023-10-05 03:00:52,834 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-05 03:00:52,860 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=310, ProcessCount=168, AvailableMemoryMB=6063 2023-10-05 03:00:52,860 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-10-05 03:00:52,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 03:00:52,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:00:52,869 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:00:52,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-05 03:00:52,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 03:00:52,872 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:00:52,875 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:52,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:52,876 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e empty. 2023-10-05 03:00:52,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c empty. 2023-10-05 03:00:52,877 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:52,877 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:52,877 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 03:00:52,893 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 03:00:52,894 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => fb1ab1f0c1a6db03716062df9986b63e, NAME => 'testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:00:52,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 454de28d50c8bd35842a7ea7953f121c, NAME => 'testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:00:52,929 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:52,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing fb1ab1f0c1a6db03716062df9986b63e, disabling compactions & flushes 2023-10-05 03:00:52,931 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:52,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:52,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 454de28d50c8bd35842a7ea7953f121c, disabling compactions & flushes 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. after waiting 0 ms 2023-10-05 03:00:52,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:52,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. after waiting 0 ms 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for fb1ab1f0c1a6db03716062df9986b63e: 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:52,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:52,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 454de28d50c8bd35842a7ea7953f121c: 2023-10-05 03:00:52,936 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:00:52,937 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474852936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474852936"}]},"ts":"1696474852936"} 2023-10-05 03:00:52,937 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474852936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474852936"}]},"ts":"1696474852936"} 2023-10-05 03:00:52,939 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:00:52,940 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:00:52,941 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474852940"}]},"ts":"1696474852940"} 2023-10-05 03:00:52,942 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 03:00:52,948 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:00:52,949 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:00:52,949 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:00:52,949 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:00:52,949 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:00:52,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, ASSIGN}] 2023-10-05 03:00:52,952 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, ASSIGN 2023-10-05 03:00:52,952 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, ASSIGN 2023-10-05 03:00:52,953 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33679,1696474826205; forceNewPlan=false, retain=false 2023-10-05 03:00:52,953 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:00:52,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 03:00:53,104 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:00:53,106 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=454de28d50c8bd35842a7ea7953f121c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,106 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fb1ab1f0c1a6db03716062df9986b63e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474853106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474853106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474853106"}]},"ts":"1696474853106"} 2023-10-05 03:00:53,107 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474853106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474853106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474853106"}]},"ts":"1696474853106"} 2023-10-05 03:00:53,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 454de28d50c8bd35842a7ea7953f121c, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:00:53,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure fb1ab1f0c1a6db03716062df9986b63e, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:00:53,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 03:00:53,264 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,265 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 03:00:53,269 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 03:00:53,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:53,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 454de28d50c8bd35842a7ea7953f121c, NAME => 'testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 03:00:53,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. service=AccessControlService 2023-10-05 03:00:53,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:53,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:53,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,275 INFO [StoreOpener-454de28d50c8bd35842a7ea7953f121c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb1ab1f0c1a6db03716062df9986b63e, NAME => 'testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 03:00:53,276 DEBUG [StoreOpener-454de28d50c8bd35842a7ea7953f121c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf 2023-10-05 03:00:53,276 DEBUG [StoreOpener-454de28d50c8bd35842a7ea7953f121c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf 2023-10-05 03:00:53,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. service=AccessControlService 2023-10-05 03:00:53,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:00:53,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:00:53,277 INFO [StoreOpener-454de28d50c8bd35842a7ea7953f121c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 454de28d50c8bd35842a7ea7953f121c columnFamilyName cf 2023-10-05 03:00:53,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,279 INFO [StoreOpener-fb1ab1f0c1a6db03716062df9986b63e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,280 INFO [StoreOpener-454de28d50c8bd35842a7ea7953f121c-1] regionserver.HStore(310): Store=454de28d50c8bd35842a7ea7953f121c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:53,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,281 DEBUG [StoreOpener-fb1ab1f0c1a6db03716062df9986b63e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf 2023-10-05 03:00:53,281 DEBUG [StoreOpener-fb1ab1f0c1a6db03716062df9986b63e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf 2023-10-05 03:00:53,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,282 INFO [StoreOpener-fb1ab1f0c1a6db03716062df9986b63e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb1ab1f0c1a6db03716062df9986b63e columnFamilyName cf 2023-10-05 03:00:53,283 INFO [StoreOpener-fb1ab1f0c1a6db03716062df9986b63e-1] regionserver.HStore(310): Store=fb1ab1f0c1a6db03716062df9986b63e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:00:53,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:00:53,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:53,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 454de28d50c8bd35842a7ea7953f121c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66233931, jitterRate=-0.013037517666816711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:53,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 454de28d50c8bd35842a7ea7953f121c: 2023-10-05 03:00:53,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:00:53,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c., pid=30, masterSystemTime=1696474853262 2023-10-05 03:00:53,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:00:53,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:53,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:53,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb1ab1f0c1a6db03716062df9986b63e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59182227, jitterRate=-0.118116095662117}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:00:53,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb1ab1f0c1a6db03716062df9986b63e: 2023-10-05 03:00:53,292 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=454de28d50c8bd35842a7ea7953f121c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,292 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474853292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474853292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474853292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474853292"}]},"ts":"1696474853292"} 2023-10-05 03:00:53,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e., pid=31, masterSystemTime=1696474853264 2023-10-05 03:00:53,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,298 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fb1ab1f0c1a6db03716062df9986b63e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,299 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474853298"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474853298"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474853298"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474853298"}]},"ts":"1696474853298"} 2023-10-05 03:00:53,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-05 03:00:53,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 454de28d50c8bd35842a7ea7953f121c, server=jenkins-hbase4.apache.org,33679,1696474826205 in 189 msec 2023-10-05 03:00:53,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, ASSIGN in 352 msec 2023-10-05 03:00:53,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-05 03:00:53,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure fb1ab1f0c1a6db03716062df9986b63e, server=jenkins-hbase4.apache.org,42403,1696474826248 in 190 msec 2023-10-05 03:00:53,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-05 03:00:53,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, ASSIGN in 358 msec 2023-10-05 03:00:53,311 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:00:53,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474853311"}]},"ts":"1696474853311"} 2023-10-05 03:00:53,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 03:00:53,316 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:00:53,317 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-05 03:00:53,319 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 03:00:53,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:53,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:53,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:53,322 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:00:53,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:53,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:53,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:53,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:00:53,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 460 msec 2023-10-05 03:00:53,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 03:00:53,476 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-05 03:00:53,479 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 03:00:53,479 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,482 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:00:53,491 DEBUG [hconnection-0x775c4869-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:53,497 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:53,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:00:53,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474853504 (current time:1696474853504). 2023-10-05 03:00:53,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:00:53,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x7e3fa0b7 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:53,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42988f46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:53,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:53,518 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:53,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e3fa0b7 to 127.0.0.1:56535 2023-10-05 03:00:53,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:53,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x02a1f1fb to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:53,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@118c300, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:53,530 DEBUG [hconnection-0x7fc9eda-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:53,531 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:53,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02a1f1fb to 127.0.0.1:56535 2023-10-05 03:00:53,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:53,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 03:00:53,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:00:53,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:00:53,543 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:00:53,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:00:53,547 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:00:53,548 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696475453548 2023-10-05 03:00:53,548 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 03:00:53,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:00:53,550 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:00:53,550 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:00:53,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 03:00:53,552 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:00:53,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-10-05 03:00:53,555 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 03:00:53,556 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696475453556 2023-10-05 03:00:53,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,571 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-05 03:00:53,571 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,573 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 03:00:53,573 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 03:00:53,573 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,573 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,576 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,576 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,576 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,576 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,576 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,577 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,577 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,577 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 03:00:53,578 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 03:00:53,578 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 03:00:53,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 03:00:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 03:00:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 03:00:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 03:00:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 03:00:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 03:00:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 03:00:53,582 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 03:00:53,582 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 03:00:53,582 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 03:00:53,585 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,585 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,591 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,592 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,592 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,592 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,592 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,593 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b1f1e60[Count = 1] remaining members to acquire global barrier 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 03:00:53,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b1f1e60[Count = 0] remaining members to acquire global barrier 2023-10-05 03:00:53,598 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 03:00:53,598 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,599 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:00:53,599 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:00:53,599 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 03:00:53,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:53,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:53,600 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:53,600 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:53,600 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,600 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. started... 2023-10-05 03:00:53,600 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. started... 2023-10-05 03:00:53,602 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb1ab1f0c1a6db03716062df9986b63e: 2023-10-05 03:00:53,602 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 454de28d50c8bd35842a7ea7953f121c: 2023-10-05 03:00:53,602 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 03:00:53,602 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:53,602 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,602 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 03:00:53,602 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,604 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:53,604 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:53,604 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:00:53,604 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:00:53,625 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. completed. 2023-10-05 03:00:53,625 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:53,626 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. completed. 2023-10-05 03:00:53,626 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:00:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:00:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 03:00:53,630 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 03:00:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:53,630 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:53,630 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 03:00:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,632 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 03:00:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33679,1696474826205': 2023-10-05 03:00:53,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 03:00:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:00:53,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 03:00:53,641 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-05 03:00:53,642 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:00:53,642 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:00:53,642 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,642 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:00:53,644 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:53,644 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:53,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,644 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:53,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:53,645 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,645 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,646 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,646 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,650 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,650 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,650 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,651 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:53,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:00:53,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:53,652 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:00:53,654 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,655 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:53,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,655 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:53,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,657 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:53,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 03:00:53,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:53,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:53,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,657 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:00:53,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:53,657 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:53,658 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,658 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,658 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,658 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,658 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,658 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:53,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:53,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 03:00:53,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 03:00:53,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,703 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 03:00:53,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696474853548Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696474853672 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696474853672Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696474853672Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696474853678 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696474853694 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696474853703 (+9 ms) 2023-10-05 03:00:53,706 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 03:00:53,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 156 msec 2023-10-05 03:00:53,852 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:53,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:00:53,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:00:53,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:00:53,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33679] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:00:53,864 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 03:00:53,864 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,864 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:00:53,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:00:53,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474853877 (current time:1696474853877). 2023-10-05 03:00:53,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:00:53,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x0a934a16 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:53,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f60cd84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:53,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:53,889 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:53,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a934a16 to 127.0.0.1:56535 2023-10-05 03:00:53,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:53,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x5f172c75 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:00:53,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76f1e6fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:00:53,901 DEBUG [hconnection-0x4b14603a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:00:53,904 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:00:53,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f172c75 to 127.0.0.1:56535 2023-10-05 03:00:53,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:00:53,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 03:00:53,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:00:53,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:00:53,914 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:00:53,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:00:53,918 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:00:53,919 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696475453919 2023-10-05 03:00:53,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:00:53,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 03:00:53,920 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:00:53,920 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:00:53,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 03:00:53,924 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:00:53,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-10-05 03:00:53,927 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 03:00:53,928 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696475453928 2023-10-05 03:00:53,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-05 03:00:53,942 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-05 03:00:53,942 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,944 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 03:00:53,944 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 03:00:53,944 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,944 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,946 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,946 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,946 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,946 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:53,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,947 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,947 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,947 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,947 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 03:00:53,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 03:00:53,948 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 03:00:53,948 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,948 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 03:00:53,949 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 03:00:53,950 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:00:53,952 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 03:00:53,952 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 03:00:53,952 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 03:00:53,954 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,954 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,955 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:53,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,956 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:00:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:53,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aa816c6[Count = 1] remaining members to acquire global barrier 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:53,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:53,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:53,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 03:00:53,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aa816c6[Count = 0] remaining members to acquire global barrier 2023-10-05 03:00:53,964 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 03:00:53,964 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:53,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:00:53,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:53,966 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 03:00:53,967 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:00:53,967 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:53,966 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:00:53,967 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. started... 2023-10-05 03:00:53,967 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:53,967 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:53,966 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:00:53,967 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fb1ab1f0c1a6db03716062df9986b63e 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 03:00:53,967 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. started... 2023-10-05 03:00:53,967 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 454de28d50c8bd35842a7ea7953f121c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 03:00:53,968 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 03:00:53,968 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:53,968 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 03:00:54,003 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100538e419ba11594fdb96f16b7273fe097c to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100538e419ba11594fdb96f16b7273fe097c 2023-10-05 03:00:54,003 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310059fabb2d2146d47fb8769e51a37951424 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310059fabb2d2146d47fb8769e51a37951424 2023-10-05 03:00:54,021 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:54,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:00:54,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:00:54,022 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:00:54,024 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/.tmp/cf/9207313f85904d5b86faca0d43e24da8 2023-10-05 03:00:54,025 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/.tmp/cf/094ec9268ac84ea1b624132954d444a8 2023-10-05 03:00:54,033 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/.tmp/cf/9207313f85904d5b86faca0d43e24da8 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf/9207313f85904d5b86faca0d43e24da8 2023-10-05 03:00:54,033 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/.tmp/cf/094ec9268ac84ea1b624132954d444a8 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf/094ec9268ac84ea1b624132954d444a8 2023-10-05 03:00:54,040 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf/9207313f85904d5b86faca0d43e24da8, entries=47, sequenceid=6, filesize=12.8 K 2023-10-05 03:00:54,040 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf/094ec9268ac84ea1b624132954d444a8, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 03:00:54,042 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for fb1ab1f0c1a6db03716062df9986b63e in 75ms, sequenceid=6, compaction requested=false 2023-10-05 03:00:54,042 INFO [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 454de28d50c8bd35842a7ea7953f121c in 75ms, sequenceid=6, compaction requested=false 2023-10-05 03:00:54,042 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 03:00:54,042 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fb1ab1f0c1a6db03716062df9986b63e: 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 454de28d50c8bd35842a7ea7953f121c: 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf/9207313f85904d5b86faca0d43e24da8] hfiles 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf/094ec9268ac84ea1b624132954d444a8] hfiles 2023-10-05 03:00:54,047 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf/094ec9268ac84ea1b624132954d444a8 for snapshot=snaptb0-testExportFileSystemState 2023-10-05 03:00:54,046 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf/9207313f85904d5b86faca0d43e24da8 for snapshot=snaptb0-testExportFileSystemState 2023-10-05 03:00:54,064 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. completed. 2023-10-05 03:00:54,065 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:00:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 03:00:54,065 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:00:54,072 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. completed. 2023-10-05 03:00:54,072 DEBUG [rs(jenkins-hbase4.apache.org,33679,1696474826205)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 03:00:54,072 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,072 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:54,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:54,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:54,073 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 03:00:54,075 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,075 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 03:00:54,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:54,076 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:54,076 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 03:00:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:00:54,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 03:00:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33679,1696474826205': 2023-10-05 03:00:54,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 03:00:54,085 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-05 03:00:54,085 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:00:54,085 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:00:54,085 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-05 03:00:54,085 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,088 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:54,088 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:54,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:00:54,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:54,089 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,089 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:00:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,091 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,092 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:00:54,092 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 03:00:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:54,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:54,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:00:54,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-05 03:00:54,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:00:54,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 03:00:54,099 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:00:54,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:54,098 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:00:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:00:54,099 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:00:54,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:00:54,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:00:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:00:54,102 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310059fabb2d2146d47fb8769e51a37951424, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100538e419ba11594fdb96f16b7273fe097c] mob files 2023-10-05 03:00:54,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310059fabb2d2146d47fb8769e51a37951424 2023-10-05 03:00:54,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100538e419ba11594fdb96f16b7273fe097c 2023-10-05 03:00:54,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-05 03:00:54,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,146 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 03:00:54,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,146 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696474853919Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696474854115 (+196 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696474854115Loading Region manifests for snaptb0-testExportFileSystemState at 1696474854115Writing data manifest for snaptb0-testExportFileSystemState at 1696474854125 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696474854136 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696474854146 (+10 ms) 2023-10-05 03:00:54,150 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 03:00:54,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 230 msec 2023-10-05 03:00:54,223 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:00:54,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:00:54,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:00:54,224 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224 2023-10-05 03:00:54,225 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34213, tgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224, rawTgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:54,248 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:00:54,249 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_14638118_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,249 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-05 03:00:54,266 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 03:00:54,294 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:54,295 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:54,296 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:54,296 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,205 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-1260313470146629196.jar 2023-10-05 03:00:55,206 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,206 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,273 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-5078006717538045648.jar 2023-10-05 03:00:55,274 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,274 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,275 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,275 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,275 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,276 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:00:55,276 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:00:55,277 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:00:55,277 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:00:55,277 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:00:55,278 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:00:55,278 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:00:55,279 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:00:55,279 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:00:55,279 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:00:55,280 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:00:55,281 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:55,281 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:55,282 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:00:55,282 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:55,282 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:00:55,283 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:00:55,283 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:00:55,754 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:00:55,756 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-05 03:00:55,759 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 03:00:56,434 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:00:56,435 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:00:56,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0001_000001 (auth:SIMPLE) 2023-10-05 03:00:56,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0002_000001 (auth:SIMPLE) 2023-10-05 03:00:58,127 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:01:00,866 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0002_000001 (auth:SIMPLE) 2023-10-05 03:01:03,092 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0002_000001 (auth:SIMPLE) 2023-10-05 03:01:06,234 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0002_000001 (auth:SIMPLE) 2023-10-05 03:01:07,946 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:01:07,946 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:01:07,955 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-05 03:01:07,955 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:01:07,955 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:01:07,956 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 03:01:07,956 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 03:01:07,956 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 03:01:07,956 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 03:01:07,957 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 03:01:07,957 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474854224/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 03:01:07,963 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-05 03:01:07,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-05 03:01:07,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:07,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 03:01:07,969 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474867969"}]},"ts":"1696474867969"} 2023-10-05 03:01:07,970 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 03:01:07,972 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-05 03:01:07,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, UNASSIGN}] 2023-10-05 03:01:07,975 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, UNASSIGN 2023-10-05 03:01:07,975 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, UNASSIGN 2023-10-05 03:01:07,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fb1ab1f0c1a6db03716062df9986b63e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:07,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=454de28d50c8bd35842a7ea7953f121c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:07,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474867976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474867976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474867976"}]},"ts":"1696474867976"} 2023-10-05 03:01:07,976 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474867976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474867976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474867976"}]},"ts":"1696474867976"} 2023-10-05 03:01:07,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure fb1ab1f0c1a6db03716062df9986b63e, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:07,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 454de28d50c8bd35842a7ea7953f121c, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:01:08,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 03:01:08,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:01:08,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 454de28d50c8bd35842a7ea7953f121c, disabling compactions & flushes 2023-10-05 03:01:08,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:01:08,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:01:08,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:01:08,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. after waiting 0 ms 2023-10-05 03:01:08,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb1ab1f0c1a6db03716062df9986b63e, disabling compactions & flushes 2023-10-05 03:01:08,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:01:08,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:01:08,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:01:08,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. after waiting 0 ms 2023-10-05 03:01:08,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:01:08,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:01:08,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:01:08,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:08,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:08,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c. 2023-10-05 03:01:08,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e. 2023-10-05 03:01:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 454de28d50c8bd35842a7ea7953f121c: 2023-10-05 03:01:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb1ab1f0c1a6db03716062df9986b63e: 2023-10-05 03:01:08,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:01:08,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=454de28d50c8bd35842a7ea7953f121c, regionState=CLOSED 2023-10-05 03:01:08,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474868150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474868150"}]},"ts":"1696474868150"} 2023-10-05 03:01:08,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:01:08,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fb1ab1f0c1a6db03716062df9986b63e, regionState=CLOSED 2023-10-05 03:01:08,151 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696474868150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474868150"}]},"ts":"1696474868150"} 2023-10-05 03:01:08,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-10-05 03:01:08,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 454de28d50c8bd35842a7ea7953f121c, server=jenkins-hbase4.apache.org,33679,1696474826205 in 173 msec 2023-10-05 03:01:08,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-10-05 03:01:08,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure fb1ab1f0c1a6db03716062df9986b63e, server=jenkins-hbase4.apache.org,42403,1696474826248 in 174 msec 2023-10-05 03:01:08,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=454de28d50c8bd35842a7ea7953f121c, UNASSIGN in 180 msec 2023-10-05 03:01:08,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-05 03:01:08,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fb1ab1f0c1a6db03716062df9986b63e, UNASSIGN in 181 msec 2023-10-05 03:01:08,157 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474868157"}]},"ts":"1696474868157"} 2023-10-05 03:01:08,158 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 03:01:08,160 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-05 03:01:08,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 197 msec 2023-10-05 03:01:08,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 03:01:08,271 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-05 03:01:08,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-05 03:01:08,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:08,276 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:08,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-05 03:01:08,277 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:08,279 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-05 03:01:08,282 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,282 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,282 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,282 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,282 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:01:08,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 03:01:08,283 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:01:08,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 03:01:08,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 03:01:08,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 03:01:08,284 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,285 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,285 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,285 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,285 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,285 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,285 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/recovered.edits] 2023-10-05 03:01:08,286 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/recovered.edits] 2023-10-05 03:01:08,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 03:01:08,290 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf/094ec9268ac84ea1b624132954d444a8 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/cf/094ec9268ac84ea1b624132954d444a8 2023-10-05 03:01:08,290 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf/9207313f85904d5b86faca0d43e24da8 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/cf/9207313f85904d5b86faca0d43e24da8 2023-10-05 03:01:08,294 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e/recovered.edits/9.seqid 2023-10-05 03:01:08,294 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c/recovered.edits/9.seqid 2023-10-05 03:01:08,295 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/fb1ab1f0c1a6db03716062df9986b63e 2023-10-05 03:01:08,295 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemState/454de28d50c8bd35842a7ea7953f121c 2023-10-05 03:01:08,295 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 03:01:08,295 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 03:01:08,296 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-05 03:01:08,297 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 03:01:08,297 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,301 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310059fabb2d2146d47fb8769e51a37951424 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202310059fabb2d2146d47fb8769e51a37951424 2023-10-05 03:01:08,303 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100538e419ba11594fdb96f16b7273fe097c to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023100538e419ba11594fdb96f16b7273fe097c 2023-10-05 03:01:08,303 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 03:01:08,306 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:08,309 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-05 03:01:08,311 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-05 03:01:08,312 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:08,312 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-05 03:01:08,312 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474868312"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:08,313 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474868312"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:08,319 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 03:01:08,319 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fb1ab1f0c1a6db03716062df9986b63e, NAME => 'testtb-testExportFileSystemState,,1696474852863.fb1ab1f0c1a6db03716062df9986b63e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 454de28d50c8bd35842a7ea7953f121c, NAME => 'testtb-testExportFileSystemState,1,1696474852863.454de28d50c8bd35842a7ea7953f121c.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 03:01:08,319 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-05 03:01:08,319 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474868319"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:08,320 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-05 03:01:08,322 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 03:01:08,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 51 msec 2023-10-05 03:01:08,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 03:01:08,388 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-05 03:01:08,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-05 03:01:08,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-05 03:01:08,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-05 03:01:08,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-05 03:01:08,428 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 754) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:41333 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:48860 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:42380 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:40081 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-601168184_1 at /127.0.0.1:48818 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:42813 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-601168184_1 at /127.0.0.1:42372 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 310), ProcessCount=168 (was 168), AvailableMemoryMB=5932 (was 6063) 2023-10-05 03:01:08,428 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 03:01:08,447 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=168, AvailableMemoryMB=5930 2023-10-05 03:01:08,448 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 03:01:08,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 03:01:08,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:08,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:01:08,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-05 03:01:08,455 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:01:08,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 03:01:08,458 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,458 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,458 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e empty. 2023-10-05 03:01:08,458 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 empty. 2023-10-05 03:01:08,459 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,459 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,459 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 03:01:08,471 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-05 03:01:08,472 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b1107758d3265db1df1704c85a410f79, NAME => 'testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:08,472 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0bf280847b57ddf4a4fc5942b088ed8e, NAME => 'testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0bf280847b57ddf4a4fc5942b088ed8e, disabling compactions & flushes 2023-10-05 03:01:08,492 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. after waiting 0 ms 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:08,492 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b1107758d3265db1df1704c85a410f79, disabling compactions & flushes 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0bf280847b57ddf4a4fc5942b088ed8e: 2023-10-05 03:01:08,492 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. after waiting 0 ms 2023-10-05 03:01:08,492 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,492 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,493 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b1107758d3265db1df1704c85a410f79: 2023-10-05 03:01:08,495 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:01:08,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474868496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474868496"}]},"ts":"1696474868496"} 2023-10-05 03:01:08,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474868496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474868496"}]},"ts":"1696474868496"} 2023-10-05 03:01:08,499 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:01:08,500 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:01:08,500 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474868500"}]},"ts":"1696474868500"} 2023-10-05 03:01:08,502 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-05 03:01:08,507 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:01:08,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:01:08,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:01:08,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:01:08,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:01:08,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, ASSIGN}] 2023-10-05 03:01:08,511 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, ASSIGN 2023-10-05 03:01:08,511 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, ASSIGN 2023-10-05 03:01:08,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:01:08,512 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39035,1696474826157; forceNewPlan=false, retain=false 2023-10-05 03:01:08,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 03:01:08,662 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:01:08,665 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0bf280847b57ddf4a4fc5942b088ed8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:08,665 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b1107758d3265db1df1704c85a410f79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:08,665 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474868665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474868665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474868665"}]},"ts":"1696474868665"} 2023-10-05 03:01:08,665 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474868665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474868665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474868665"}]},"ts":"1696474868665"} 2023-10-05 03:01:08,667 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 0bf280847b57ddf4a4fc5942b088ed8e, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:01:08,668 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure b1107758d3265db1df1704c85a410f79, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:08,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 03:01:08,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1107758d3265db1df1704c85a410f79, NAME => 'testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 03:01:08,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bf280847b57ddf4a4fc5942b088ed8e, NAME => 'testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. service=AccessControlService 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. service=AccessControlService 2023-10-05 03:01:08,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:08,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,829 INFO [StoreOpener-0bf280847b57ddf4a4fc5942b088ed8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,829 INFO [StoreOpener-b1107758d3265db1df1704c85a410f79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,830 DEBUG [StoreOpener-0bf280847b57ddf4a4fc5942b088ed8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf 2023-10-05 03:01:08,830 DEBUG [StoreOpener-0bf280847b57ddf4a4fc5942b088ed8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf 2023-10-05 03:01:08,830 DEBUG [StoreOpener-b1107758d3265db1df1704c85a410f79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf 2023-10-05 03:01:08,830 DEBUG [StoreOpener-b1107758d3265db1df1704c85a410f79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf 2023-10-05 03:01:08,831 INFO [StoreOpener-0bf280847b57ddf4a4fc5942b088ed8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bf280847b57ddf4a4fc5942b088ed8e columnFamilyName cf 2023-10-05 03:01:08,831 INFO [StoreOpener-b1107758d3265db1df1704c85a410f79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1107758d3265db1df1704c85a410f79 columnFamilyName cf 2023-10-05 03:01:08,832 INFO [StoreOpener-b1107758d3265db1df1704c85a410f79-1] regionserver.HStore(310): Store=b1107758d3265db1df1704c85a410f79/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:08,832 INFO [StoreOpener-0bf280847b57ddf4a4fc5942b088ed8e-1] regionserver.HStore(310): Store=0bf280847b57ddf4a4fc5942b088ed8e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:08,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:08,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:08,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:08,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:08,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1107758d3265db1df1704c85a410f79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62443926, jitterRate=-0.0695129930973053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:08,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1107758d3265db1df1704c85a410f79: 2023-10-05 03:01:08,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0bf280847b57ddf4a4fc5942b088ed8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67505259, jitterRate=0.005906745791435242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:08,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0bf280847b57ddf4a4fc5942b088ed8e: 2023-10-05 03:01:08,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e., pid=45, masterSystemTime=1696474868819 2023-10-05 03:01:08,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79., pid=46, masterSystemTime=1696474868820 2023-10-05 03:01:08,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:08,844 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b1107758d3265db1df1704c85a410f79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:08,844 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474868843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474868843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474868843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474868843"}]},"ts":"1696474868843"} 2023-10-05 03:01:08,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:08,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0bf280847b57ddf4a4fc5942b088ed8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:08,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474868845"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474868845"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474868845"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474868845"}]},"ts":"1696474868845"} 2023-10-05 03:01:08,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-05 03:01:08,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure b1107758d3265db1df1704c85a410f79, server=jenkins-hbase4.apache.org,42403,1696474826248 in 178 msec 2023-10-05 03:01:08,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-05 03:01:08,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 0bf280847b57ddf4a4fc5942b088ed8e, server=jenkins-hbase4.apache.org,39035,1696474826157 in 180 msec 2023-10-05 03:01:08,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, ASSIGN in 341 msec 2023-10-05 03:01:08,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-10-05 03:01:08,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, ASSIGN in 342 msec 2023-10-05 03:01:08,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:01:08,854 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474868853"}]},"ts":"1696474868853"} 2023-10-05 03:01:08,855 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-05 03:01:08,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:01:08,858 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-05 03:01:08,860 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 03:01:08,862 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,862 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,862 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,862 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:08,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:08,864 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:08,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:08,864 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:08,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 413 msec 2023-10-05 03:01:09,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 03:01:09,059 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-05 03:01:09,062 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 03:01:09,062 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:09,064 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:01:09,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 03:01:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474869077 (current time:1696474869077). 2023-10-05 03:01:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:09,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x6be4b9b2 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:09,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c98579e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:09,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:09,091 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:09,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6be4b9b2 to 127.0.0.1:56535 2023-10-05 03:01:09,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:09,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x256ef041 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:09,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35f3c199, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:09,101 DEBUG [hconnection-0x3bffd70a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:09,103 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:09,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x256ef041 to 127.0.0.1:56535 2023-10-05 03:01:09,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:09,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 03:01:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:09,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 03:01:09,112 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:09,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 03:01:09,115 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 03:01:09,116 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696475469115 2023-10-05 03:01:09,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 03:01:09,116 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 03:01:09,117 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:09,117 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:09,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 03:01:09,119 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 03:01:09,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-05 03:01:09,121 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 03:01:09,123 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696475469123 2023-10-05 03:01:09,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,137 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-05 03:01:09,137 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,138 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 03:01:09,138 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 03:01:09,139 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,139 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,141 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,141 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,141 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,141 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,141 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,142 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,142 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,142 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:09,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 03:01:09,143 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 03:01:09,143 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,143 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 03:01:09,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 03:01:09,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,145 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,148 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 03:01:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 03:01:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 03:01:09,152 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 03:01:09,151 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 03:01:09,152 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 03:01:09,153 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:09,154 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:09,157 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,157 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@203ff4a7[Count = 1] remaining members to acquire global barrier 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 03:01:09,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@203ff4a7[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:09,162 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 03:01:09,162 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 03:01:09,164 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 03:01:09,164 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 03:01:09,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,164 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 03:01:09,164 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:09,165 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:09,165 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,165 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:09,164 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:09,164 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:09,165 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:09,165 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. started... 2023-10-05 03:01:09,165 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. started... 2023-10-05 03:01:09,165 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bf280847b57ddf4a4fc5942b088ed8e: 2023-10-05 03:01:09,167 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1107758d3265db1df1704c85a410f79: 2023-10-05 03:01:09,167 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,167 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,167 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:09,169 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:09,169 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:01:09,169 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:01:09,180 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 03:01:09,180 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,180 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 03:01:09,191 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. completed. 2023-10-05 03:01:09,191 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:09,191 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. completed. 2023-10-05 03:01:09,191 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:09,191 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 03:01:09,192 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:09,194 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 03:01:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 03:01:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,194 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,194 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 03:01:09,195 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,196 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 03:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 03:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 03:01:09,204 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-05 03:01:09,204 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:09,204 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:09,204 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,204 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:09,206 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,206 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,206 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,206 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,206 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,207 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,207 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,208 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,208 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,212 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,212 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,213 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,216 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,216 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,216 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,216 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,216 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,217 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,217 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,216 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,217 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:09,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,217 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 03:01:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:01:09,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,218 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:01:09,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,220 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:01:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,220 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,261 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 03:01:09,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,261 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:09,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696474869116Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696474869232 (+116 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696474869232Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696474869232Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696474869236 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696474869254 (+18 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696474869261 (+7 ms) 2023-10-05 03:01:09,264 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 03:01:09,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 147 msec 2023-10-05 03:01:09,420 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:09,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 03:01:09,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:09,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39035] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:01:09,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:01:09,429 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 03:01:09,430 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:09,430 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:01:09,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 03:01:09,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474869441 (current time:1696474869441). 2023-10-05 03:01:09,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:09,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x292c6a64 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:09,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e8e6119, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:09,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:09,459 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:09,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x292c6a64 to 127.0.0.1:56535 2023-10-05 03:01:09,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:09,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x74201cac to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:09,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e152706, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:09,471 DEBUG [hconnection-0x43ee0f74-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:09,472 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74201cac to 127.0.0.1:56535 2023-10-05 03:01:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 03:01:09,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:09,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 03:01:09,483 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:09,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 03:01:09,485 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 03:01:09,486 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696475469486 2023-10-05 03:01:09,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 03:01:09,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 03:01:09,487 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:09,488 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:09,491 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 03:01:09,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 03:01:09,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-05 03:01:09,493 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 03:01:09,494 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696475469494 2023-10-05 03:01:09,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-05 03:01:09,503 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-05 03:01:09,503 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,504 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 03:01:09,504 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 03:01:09,505 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,505 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,508 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,508 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,508 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,508 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,508 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,508 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,508 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,508 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 03:01:09,509 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 03:01:09,509 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 03:01:09,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 03:01:09,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:09,511 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 03:01:09,513 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 03:01:09,512 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 03:01:09,513 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 03:01:09,513 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 03:01:09,513 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 03:01:09,513 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 03:01:09,514 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,514 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,515 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,515 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1706a9d6[Count = 1] remaining members to acquire global barrier 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 03:01:09,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1706a9d6[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:09,519 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 03:01:09,519 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 03:01:09,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 03:01:09,520 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:09,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,520 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. started... 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 03:01:09,520 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,520 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:09,521 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:09,521 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:09,521 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b1107758d3265db1df1704c85a410f79 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-05 03:01:09,520 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:09,521 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:09,521 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. started... 2023-10-05 03:01:09,521 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0bf280847b57ddf4a4fc5942b088ed8e 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-05 03:01:09,524 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 03:01:09,524 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,524 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 03:01:09,550 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100569f5f54e30694f8fb8464497318c16f1 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100569f5f54e30694f8fb8464497318c16f1 2023-10-05 03:01:09,550 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005fbb6ec7cac4644a793c20fa4ab1bbf92 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005fbb6ec7cac4644a793c20fa4ab1bbf92 2023-10-05 03:01:09,562 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/.tmp/cf/9719d9e16a5f4e368c39d0519d7741da 2023-10-05 03:01:09,566 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/.tmp/cf/c7291249c84e4aa39dcf8b5bb4138731 2023-10-05 03:01:09,572 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/.tmp/cf/9719d9e16a5f4e368c39d0519d7741da as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf/9719d9e16a5f4e368c39d0519d7741da 2023-10-05 03:01:09,572 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/.tmp/cf/c7291249c84e4aa39dcf8b5bb4138731 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf/c7291249c84e4aa39dcf8b5bb4138731 2023-10-05 03:01:09,577 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf/c7291249c84e4aa39dcf8b5bb4138731, entries=45, sequenceid=6, filesize=12.4 K 2023-10-05 03:01:09,577 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf/9719d9e16a5f4e368c39d0519d7741da, entries=5, sequenceid=6, filesize=5.7 K 2023-10-05 03:01:09,578 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0bf280847b57ddf4a4fc5942b088ed8e in 57ms, sequenceid=6, compaction requested=false 2023-10-05 03:01:09,578 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b1107758d3265db1df1704c85a410f79 in 58ms, sequenceid=6, compaction requested=false 2023-10-05 03:01:09,578 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 03:01:09,578 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0bf280847b57ddf4a4fc5942b088ed8e: 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b1107758d3265db1df1704c85a410f79: 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf/9719d9e16a5f4e368c39d0519d7741da] hfiles 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf/c7291249c84e4aa39dcf8b5bb4138731] hfiles 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf/9719d9e16a5f4e368c39d0519d7741da for snapshot=snaptb0-testConsecutiveExports 2023-10-05 03:01:09,580 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf/c7291249c84e4aa39dcf8b5bb4138731 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 03:01:09,588 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. completed. 2023-10-05 03:01:09,588 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:09,588 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. completed. 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:09,588 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:09,588 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 03:01:09,588 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 03:01:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:01:09,589 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:01:09,590 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,590 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 03:01:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,590 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 03:01:09,590 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,590 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,591 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 03:01:09,591 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,592 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 03:01:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:01:09,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 03:01:09,599 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-05 03:01:09,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:09,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:09,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-05 03:01:09,600 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:09,601 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,601 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,601 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,601 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,601 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,601 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,602 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,602 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:09,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,602 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,603 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,606 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:09,606 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 03:01:09,606 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,613 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:09,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-05 03:01:09,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:09,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,613 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 03:01:09,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:09,615 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:09,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 03:01:09,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:09,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,616 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100569f5f54e30694f8fb8464497318c16f1, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005fbb6ec7cac4644a793c20fa4ab1bbf92] mob files 2023-10-05 03:01:09,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100569f5f54e30694f8fb8464497318c16f1 2023-10-05 03:01:09,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005fbb6ec7cac4644a793c20fa4ab1bbf92 2023-10-05 03:01:09,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-05 03:01:09,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,654 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 03:01:09,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,655 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696474869487Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696474869626 (+139 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696474869626Loading Region manifests for snaptb0-testConsecutiveExports at 1696474869626Writing data manifest for snaptb0-testConsecutiveExports at 1696474869635 (+9 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696474869646 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696474869654 (+8 ms) 2023-10-05 03:01:09,657 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 03:01:09,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 170 msec 2023-10-05 03:01:09,790 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:09,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 03:01:09,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:09,791 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791 2023-10-05 03:01:09,792 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:09,814 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:09,814 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a21a3c7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,814 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 03:01:09,823 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:09,835 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:09,835 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:09,835 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:09,836 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,713 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-6474348569629860888.jar 2023-10-05 03:01:10,713 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,714 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,780 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-7598800865525490385.jar 2023-10-05 03:01:10,781 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,781 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,782 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,782 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,782 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,783 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:10,783 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:01:10,783 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:01:10,784 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:01:10,784 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:01:10,784 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:01:10,785 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:01:10,785 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:01:10,786 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:01:10,786 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:01:10,786 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:01:10,787 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:10,787 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:10,788 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:10,788 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:10,788 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:10,789 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:10,789 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:11,156 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:01:11,159 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 03:01:11,161 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 03:01:12,407 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:12,407 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:12,411 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0002_000001 (auth:SIMPLE) 2023-10-05 03:01:13,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0003_000001 (auth:SIMPLE) 2023-10-05 03:01:13,729 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:01:16,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0003_000001 (auth:SIMPLE) 2023-10-05 03:01:19,194 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0003_000001 (auth:SIMPLE) 2023-10-05 03:01:21,529 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0003_000001 (auth:SIMPLE) 2023-10-05 03:01:23,326 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:01:23,327 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:01:23,331 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 03:01:23,331 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:01:23,332 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:01:23,332 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 03:01:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 03:01:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 03:01:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e949571 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 03:01:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 03:01:23,335 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 03:01:23,336 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:23,359 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:23,359 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1777376f, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:23,359 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 03:01:23,370 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 03:01:23,382 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:23,382 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:23,383 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:23,383 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,253 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-3653905201593015070.jar 2023-10-05 03:01:24,254 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,254 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,320 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-7647377708560761696.jar 2023-10-05 03:01:24,321 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,321 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,321 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,322 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,322 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,322 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:24,323 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:01:24,323 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:01:24,324 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:01:24,324 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:01:24,324 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:01:24,325 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:01:24,325 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:01:24,325 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:01:24,326 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:01:24,326 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:01:24,327 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:24,327 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:24,328 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:24,328 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:24,328 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:24,329 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:24,329 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:24,711 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:01:24,714 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 03:01:24,716 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 03:01:27,701 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:27,701 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:27,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0003_000001 (auth:SIMPLE) 2023-10-05 03:01:28,419 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0004_000001 (auth:SIMPLE) 2023-10-05 03:01:32,255 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0004_000001 (auth:SIMPLE) 2023-10-05 03:01:34,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0004_000001 (auth:SIMPLE) 2023-10-05 03:01:36,752 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0004_000001 (auth:SIMPLE) 2023-10-05 03:01:37,886 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:01:37,886 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:01:37,889 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 03:01:37,889 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:01:37,890 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:01:37,890 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 03:01:37,894 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 03:01:37,894 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 03:01:37,894 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5e949571 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 03:01:37,894 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 03:01:37,894 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/local-export-1696474869791/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 03:01:37,907 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-05 03:01:37,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-05 03:01:37,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:37,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 03:01:37,912 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474897912"}]},"ts":"1696474897912"} 2023-10-05 03:01:37,913 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-05 03:01:37,921 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-05 03:01:37,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, UNASSIGN}] 2023-10-05 03:01:37,924 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, UNASSIGN 2023-10-05 03:01:37,924 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, UNASSIGN 2023-10-05 03:01:37,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0bf280847b57ddf4a4fc5942b088ed8e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:37,925 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b1107758d3265db1df1704c85a410f79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:37,925 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474897925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474897925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474897925"}]},"ts":"1696474897925"} 2023-10-05 03:01:37,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474897925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474897925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474897925"}]},"ts":"1696474897925"} 2023-10-05 03:01:37,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 0bf280847b57ddf4a4fc5942b088ed8e, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:01:37,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure b1107758d3265db1df1704c85a410f79, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:38,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 03:01:38,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:38,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0bf280847b57ddf4a4fc5942b088ed8e, disabling compactions & flushes 2023-10-05 03:01:38,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:38,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:38,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. after waiting 0 ms 2023-10-05 03:01:38,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:38,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:38,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1107758d3265db1df1704c85a410f79, disabling compactions & flushes 2023-10-05 03:01:38,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. after waiting 0 ms 2023-10-05 03:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:38,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:01:38,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:01:38,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:38,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:38,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e. 2023-10-05 03:01:38,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0bf280847b57ddf4a4fc5942b088ed8e: 2023-10-05 03:01:38,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79. 2023-10-05 03:01:38,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1107758d3265db1df1704c85a410f79: 2023-10-05 03:01:38,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:38,100 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b1107758d3265db1df1704c85a410f79, regionState=CLOSED 2023-10-05 03:01:38,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:38,100 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474898100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474898100"}]},"ts":"1696474898100"} 2023-10-05 03:01:38,101 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0bf280847b57ddf4a4fc5942b088ed8e, regionState=CLOSED 2023-10-05 03:01:38,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696474898101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474898101"}]},"ts":"1696474898101"} 2023-10-05 03:01:38,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-05 03:01:38,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure b1107758d3265db1df1704c85a410f79, server=jenkins-hbase4.apache.org,42403,1696474826248 in 174 msec 2023-10-05 03:01:38,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-05 03:01:38,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 0bf280847b57ddf4a4fc5942b088ed8e, server=jenkins-hbase4.apache.org,39035,1696474826157 in 175 msec 2023-10-05 03:01:38,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b1107758d3265db1df1704c85a410f79, UNASSIGN in 181 msec 2023-10-05 03:01:38,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-05 03:01:38,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0bf280847b57ddf4a4fc5942b088ed8e, UNASSIGN in 182 msec 2023-10-05 03:01:38,106 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474898106"}]},"ts":"1696474898106"} 2023-10-05 03:01:38,108 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-05 03:01:38,109 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-05 03:01:38,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 203 msec 2023-10-05 03:01:38,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 03:01:38,213 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-05 03:01:38,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-05 03:01:38,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:38,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:38,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-05 03:01:38,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:38,221 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-05 03:01:38,224 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,224 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,224 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,224 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:38,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 03:01:38,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 03:01:38,225 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 03:01:38,225 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,226 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:38,227 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/recovered.edits] 2023-10-05 03:01:38,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,228 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,228 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,228 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-10-05 03:01:38,228 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,228 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 03:01:38,227 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/recovered.edits] 2023-10-05 03:01:38,228 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,228 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 03:01:38,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 03:01:38,232 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf/9719d9e16a5f4e368c39d0519d7741da to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/cf/9719d9e16a5f4e368c39d0519d7741da 2023-10-05 03:01:38,232 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf/c7291249c84e4aa39dcf8b5bb4138731 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/cf/c7291249c84e4aa39dcf8b5bb4138731 2023-10-05 03:01:38,235 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e/recovered.edits/9.seqid 2023-10-05 03:01:38,235 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/0bf280847b57ddf4a4fc5942b088ed8e 2023-10-05 03:01:38,236 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79/recovered.edits/9.seqid 2023-10-05 03:01:38,236 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testConsecutiveExports/b1107758d3265db1df1704c85a410f79 2023-10-05 03:01:38,236 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 03:01:38,237 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 03:01:38,237 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-05 03:01:38,241 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100569f5f54e30694f8fb8464497318c16f1 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023100569f5f54e30694f8fb8464497318c16f1 2023-10-05 03:01:38,242 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005fbb6ec7cac4644a793c20fa4ab1bbf92 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005fbb6ec7cac4644a793c20fa4ab1bbf92 2023-10-05 03:01:38,243 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 03:01:38,245 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:38,248 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-05 03:01:38,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-05 03:01:38,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:38,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-05 03:01:38,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474898251"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:38,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474898251"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:38,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 03:01:38,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0bf280847b57ddf4a4fc5942b088ed8e, NAME => 'testtb-testConsecutiveExports,,1696474868449.0bf280847b57ddf4a4fc5942b088ed8e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b1107758d3265db1df1704c85a410f79, NAME => 'testtb-testConsecutiveExports,1,1696474868449.b1107758d3265db1df1704c85a410f79.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 03:01:38,253 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-05 03:01:38,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474898253"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:38,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-05 03:01:38,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 03:01:38,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 43 msec 2023-10-05 03:01:38,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 03:01:38,330 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-05 03:01:38,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-05 03:01:38,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-05 03:01:38,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-05 03:01:38,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-05 03:01:38,369 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=752 (was 765), OpenFileDescriptor=903 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 256), ProcessCount=167 (was 168), AvailableMemoryMB=5915 (was 5930) 2023-10-05 03:01:38,369 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-10-05 03:01:38,389 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=752, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=167, AvailableMemoryMB=5914 2023-10-05 03:01:38,390 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-10-05 03:01:38,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 03:01:38,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:38,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:01:38,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-05 03:01:38,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:01:38,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 03:01:38,399 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,399 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,400 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 empty. 2023-10-05 03:01:38,400 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b empty. 2023-10-05 03:01:38,400 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,400 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,400 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 03:01:38,413 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-05 03:01:38,414 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9526df8401555887dd260f5b453ef789, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:38,415 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 70fc575e078a0ba026f4699963140a0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:38,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:38,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 70fc575e078a0ba026f4699963140a0b, disabling compactions & flushes 2023-10-05 03:01:38,432 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. after waiting 0 ms 2023-10-05 03:01:38,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,432 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,432 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 70fc575e078a0ba026f4699963140a0b: 2023-10-05 03:01:38,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:38,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9526df8401555887dd260f5b453ef789, disabling compactions & flushes 2023-10-05 03:01:38,437 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. after waiting 0 ms 2023-10-05 03:01:38,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,438 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9526df8401555887dd260f5b453ef789: 2023-10-05 03:01:38,440 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:01:38,441 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474898441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474898441"}]},"ts":"1696474898441"} 2023-10-05 03:01:38,441 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474898441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474898441"}]},"ts":"1696474898441"} 2023-10-05 03:01:38,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:01:38,451 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:01:38,451 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474898451"}]},"ts":"1696474898451"} 2023-10-05 03:01:38,452 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-05 03:01:38,455 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:01:38,457 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:01:38,457 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:01:38,457 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:01:38,457 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:01:38,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, ASSIGN}] 2023-10-05 03:01:38,459 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, ASSIGN 2023-10-05 03:01:38,460 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, ASSIGN 2023-10-05 03:01:38,461 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:01:38,461 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39035,1696474826157; forceNewPlan=false, retain=false 2023-10-05 03:01:38,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 03:01:38,611 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:01:38,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=70fc575e078a0ba026f4699963140a0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:38,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9526df8401555887dd260f5b453ef789, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:38,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474898614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474898614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474898614"}]},"ts":"1696474898614"} 2023-10-05 03:01:38,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474898614"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474898614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474898614"}]},"ts":"1696474898614"} 2023-10-05 03:01:38,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 9526df8401555887dd260f5b453ef789, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:38,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 70fc575e078a0ba026f4699963140a0b, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:01:38,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 03:01:38,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9526df8401555887dd260f5b453ef789, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 03:01:38,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70fc575e078a0ba026f4699963140a0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 03:01:38,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. service=AccessControlService 2023-10-05 03:01:38,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. service=AccessControlService 2023-10-05 03:01:38,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:38,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,775 INFO [StoreOpener-70fc575e078a0ba026f4699963140a0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,775 INFO [StoreOpener-9526df8401555887dd260f5b453ef789-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,780 DEBUG [StoreOpener-70fc575e078a0ba026f4699963140a0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf 2023-10-05 03:01:38,780 DEBUG [StoreOpener-9526df8401555887dd260f5b453ef789-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf 2023-10-05 03:01:38,780 DEBUG [StoreOpener-70fc575e078a0ba026f4699963140a0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf 2023-10-05 03:01:38,780 DEBUG [StoreOpener-9526df8401555887dd260f5b453ef789-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf 2023-10-05 03:01:38,781 INFO [StoreOpener-70fc575e078a0ba026f4699963140a0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70fc575e078a0ba026f4699963140a0b columnFamilyName cf 2023-10-05 03:01:38,781 INFO [StoreOpener-9526df8401555887dd260f5b453ef789-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9526df8401555887dd260f5b453ef789 columnFamilyName cf 2023-10-05 03:01:38,783 INFO [StoreOpener-9526df8401555887dd260f5b453ef789-1] regionserver.HStore(310): Store=9526df8401555887dd260f5b453ef789/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:38,783 INFO [StoreOpener-70fc575e078a0ba026f4699963140a0b-1] regionserver.HStore(310): Store=70fc575e078a0ba026f4699963140a0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:38,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:38,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:38,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:38,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 70fc575e078a0ba026f4699963140a0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73450834, jitterRate=0.09450271725654602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:38,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:38,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 70fc575e078a0ba026f4699963140a0b: 2023-10-05 03:01:38,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9526df8401555887dd260f5b453ef789; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65012794, jitterRate=-0.031233876943588257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:38,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9526df8401555887dd260f5b453ef789: 2023-10-05 03:01:38,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b., pid=61, masterSystemTime=1696474898769 2023-10-05 03:01:38,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789., pid=60, masterSystemTime=1696474898767 2023-10-05 03:01:38,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:38,796 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=70fc575e078a0ba026f4699963140a0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:38,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:38,796 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474898796"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474898796"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474898796"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474898796"}]},"ts":"1696474898796"} 2023-10-05 03:01:38,797 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9526df8401555887dd260f5b453ef789, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:38,797 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474898796"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474898796"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474898796"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474898796"}]},"ts":"1696474898796"} 2023-10-05 03:01:38,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-05 03:01:38,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 70fc575e078a0ba026f4699963140a0b, server=jenkins-hbase4.apache.org,39035,1696474826157 in 181 msec 2023-10-05 03:01:38,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-05 03:01:38,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 9526df8401555887dd260f5b453ef789, server=jenkins-hbase4.apache.org,42403,1696474826248 in 182 msec 2023-10-05 03:01:38,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, ASSIGN in 343 msec 2023-10-05 03:01:38,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-10-05 03:01:38,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, ASSIGN in 343 msec 2023-10-05 03:01:38,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:01:38,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474898803"}]},"ts":"1696474898803"} 2023-10-05 03:01:38,805 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-05 03:01:38,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:01:38,808 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-05 03:01:38,810 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 03:01:38,811 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,811 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,811 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,811 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:38,813 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:38,813 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:38,813 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:38,813 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:38,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 421 msec 2023-10-05 03:01:39,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 03:01:39,001 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-05 03:01:39,004 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,004 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:39,006 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:01:39,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 03:01:39,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474899021 (current time:1696474899021). 2023-10-05 03:01:39,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:39,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x65b02292 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:39,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29b09736, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:39,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:39,032 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:39,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65b02292 to 127.0.0.1:56535 2023-10-05 03:01:39,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:39,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x1423dd0d to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:39,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70e3d9a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:39,040 DEBUG [hconnection-0x5d47e9a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:39,043 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:39,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1423dd0d to 127.0.0.1:56535 2023-10-05 03:01:39,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:39,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 03:01:39,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:39,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 03:01:39,050 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:39,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 03:01:39,053 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 03:01:39,053 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696475499053 2023-10-05 03:01:39,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 03:01:39,055 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:39,055 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:39,056 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 03:01:39,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 03:01:39,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 03:01:39,057 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 03:01:39,058 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696475499058 2023-10-05 03:01:39,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,067 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 03:01:39,067 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,068 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 03:01:39,068 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 03:01:39,068 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,068 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,070 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,070 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,070 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,070 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,070 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,070 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,071 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 03:01:39,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 03:01:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 03:01:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,072 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,073 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 03:01:39,074 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 03:01:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 03:01:39,075 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 03:01:39,077 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,077 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,078 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,078 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,078 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,078 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,078 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,078 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34c94948[Count = 1] remaining members to acquire global barrier 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 03:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34c94948[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:39,082 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 03:01:39,083 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 03:01:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:39,084 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:39,084 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. started... 2023-10-05 03:01:39,084 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 03:01:39,085 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. started... 2023-10-05 03:01:39,084 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,085 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9526df8401555887dd260f5b453ef789: 2023-10-05 03:01:39,085 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:39,084 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70fc575e078a0ba026f4699963140a0b: 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:01:39,085 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:39,086 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:01:39,096 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 03:01:39,096 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,096 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 03:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. completed. 2023-10-05 03:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. completed. 2023-10-05 03:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:39,105 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:39,105 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 03:01:39,107 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,107 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 03:01:39,107 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 03:01:39,108 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,108 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 03:01:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:01:39,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 03:01:39,116 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 03:01:39,116 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:39,116 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:39,116 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,116 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,118 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,119 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,119 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,120 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,121 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,122 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,123 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,126 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,126 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,126 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,126 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,126 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,128 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,126 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,126 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,128 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,128 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,128 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:01:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,128 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,128 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 03:01:39,129 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,129 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,129 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,129 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,129 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,156 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:39,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 03:01:39,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:01:39,157 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:01:39,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 03:01:39,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,158 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696474899054Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696474899140 (+86 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696474899140Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696474899140Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696474899143 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696474899152 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696474899158 (+6 ms) 2023-10-05 03:01:39,161 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 03:01:39,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 107 msec 2023-10-05 03:01:39,357 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:39,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 03:01:39,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:39,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:01:39,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39035] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:01:39,365 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,365 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:39,365 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:01:39,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 03:01:39,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474899375 (current time:1696474899375). 2023-10-05 03:01:39,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:39,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x350e5a0e to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:39,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@696da8a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:39,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:39,387 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:39,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x350e5a0e to 127.0.0.1:56535 2023-10-05 03:01:39,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:39,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x2c88f28f to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:39,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b91133a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:39,398 DEBUG [hconnection-0x6f3dae76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:39,401 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:39,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c88f28f to 127.0.0.1:56535 2023-10-05 03:01:39,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:39,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 03:01:39,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:39,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 03:01:39,409 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 03:01:39,411 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 03:01:39,412 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696475499412 2023-10-05 03:01:39,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 03:01:39,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,413 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:39,413 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:39,414 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 03:01:39,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 03:01:39,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 03:01:39,416 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 03:01:39,416 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696475499416 2023-10-05 03:01:39,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,425 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 03:01:39,425 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,426 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 03:01:39,426 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 03:01:39,426 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,426 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,429 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,429 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,429 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,429 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,429 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,429 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,430 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 03:01:39,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 03:01:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 03:01:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 03:01:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 03:01:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 03:01:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,432 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 03:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 03:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 03:01:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 03:01:39,431 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:39,434 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 03:01:39,434 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 03:01:39,434 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 03:01:39,435 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,436 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,436 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:39,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eed6731[Count = 1] remaining members to acquire global barrier 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 03:01:39,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eed6731[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:39,440 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 03:01:39,440 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,441 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 03:01:39,441 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 03:01:39,441 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 03:01:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:39,441 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:39,442 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:39,442 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. started... 2023-10-05 03:01:39,442 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,442 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:39,442 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 70fc575e078a0ba026f4699963140a0b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 03:01:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 03:01:39,449 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,449 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 03:01:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 03:01:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:39,451 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:39,451 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:39,451 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. started... 2023-10-05 03:01:39,451 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9526df8401555887dd260f5b453ef789 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 03:01:39,469 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005c597f87f16664ab6b986f4878453bd86 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005c597f87f16664ab6b986f4878453bd86 2023-10-05 03:01:39,480 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005747361227b1e49e99cadf950033e05b3 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005747361227b1e49e99cadf950033e05b3 2023-10-05 03:01:39,482 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/.tmp/cf/9c7d8b8e92e643da9dbffa315ce56e69 2023-10-05 03:01:39,487 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/.tmp/cf/9c7d8b8e92e643da9dbffa315ce56e69 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf/9c7d8b8e92e643da9dbffa315ce56e69 2023-10-05 03:01:39,487 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/.tmp/cf/2e09205e5f8243c9878cafa50057acd5 2023-10-05 03:01:39,493 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf/9c7d8b8e92e643da9dbffa315ce56e69, entries=46, sequenceid=6, filesize=13.3 K 2023-10-05 03:01:39,493 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/.tmp/cf/2e09205e5f8243c9878cafa50057acd5 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf/2e09205e5f8243c9878cafa50057acd5 2023-10-05 03:01:39,493 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 70fc575e078a0ba026f4699963140a0b in 51ms, sequenceid=6, compaction requested=false 2023-10-05 03:01:39,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 03:01:39,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 70fc575e078a0ba026f4699963140a0b: 2023-10-05 03:01:39,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:39,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf/9c7d8b8e92e643da9dbffa315ce56e69] hfiles 2023-10-05 03:01:39,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf/9c7d8b8e92e643da9dbffa315ce56e69 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,498 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf/2e09205e5f8243c9878cafa50057acd5, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 03:01:39,499 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9526df8401555887dd260f5b453ef789 in 48ms, sequenceid=6, compaction requested=false 2023-10-05 03:01:39,501 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9526df8401555887dd260f5b453ef789: 2023-10-05 03:01:39,501 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,501 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:39,501 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf/2e09205e5f8243c9878cafa50057acd5] hfiles 2023-10-05 03:01:39,501 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf/2e09205e5f8243c9878cafa50057acd5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,502 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. completed. 2023-10-05 03:01:39,502 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:39,502 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 03:01:39,503 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:39,504 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,504 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 03:01:39,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,504 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,505 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 03:01:39,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:01:39,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 03:01:39,513 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:39,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 03:01:39,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:01:39,514 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:01:39,515 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. completed. 2023-10-05 03:01:39,515 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:39,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:39,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:39,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 03:01:39,515 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:39,517 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,517 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 03:01:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,517 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,517 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 03:01:39,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:39,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 03:01:39,522 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 03:01:39,522 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:39,522 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:39,522 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,522 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:39,529 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,529 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,529 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,529 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,529 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,529 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:39,530 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,530 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,530 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,532 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:39,532 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,533 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,535 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,535 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,535 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,535 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,535 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,535 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:39,536 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,536 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,535 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,537 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:39,536 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,536 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:01:39,537 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:39,537 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:39,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:39,538 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,538 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,538 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:39,538 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,538 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,538 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:39,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:39,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005c597f87f16664ab6b986f4878453bd86, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005747361227b1e49e99cadf950033e05b3] mob files 2023-10-05 03:01:39,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005c597f87f16664ab6b986f4878453bd86 2023-10-05 03:01:39,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005747361227b1e49e99cadf950033e05b3 2023-10-05 03:01:39,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 03:01:39,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,570 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:39,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696474899412Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696474899549 (+137 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696474899549Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696474899549Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696474899552 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696474899563 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696474899570 (+7 ms) 2023-10-05 03:01:39,573 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 03:01:39,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 160 msec 2023-10-05 03:01:39,715 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:39,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 03:01:39,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:39,744 DEBUG [Listener at jenkins-hbase4.apache.org/40081] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 03:01:39,749 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 03:01:39,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33679] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 03:01:39,751 DEBUG [Listener at jenkins-hbase4.apache.org/40081] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 03:01:39,755 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 03:01:39,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39035] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 03:01:39,755 DEBUG [Listener at jenkins-hbase4.apache.org/40081] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 03:01:39,757 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 03:01:39,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 03:01:39,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 03:01:39,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:39,762 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:01:39,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-05 03:01:39,763 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:01:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 03:01:39,765 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:39,765 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:39,765 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 empty. 2023-10-05 03:01:39,765 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 empty. 2023-10-05 03:01:39,766 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:39,766 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:39,766 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 03:01:39,777 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-05 03:01:39,778 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2a4436cf959515f774d04b5583a07385, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:39,778 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f67bf3d7135f9e14bbde8c996cdf2657, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f67bf3d7135f9e14bbde8c996cdf2657, disabling compactions & flushes 2023-10-05 03:01:39,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. after waiting 0 ms 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 2a4436cf959515f774d04b5583a07385, disabling compactions & flushes 2023-10-05 03:01:39,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:39,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f67bf3d7135f9e14bbde8c996cdf2657: 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. after waiting 0 ms 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:39,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:39,791 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 2a4436cf959515f774d04b5583a07385: 2023-10-05 03:01:39,794 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:01:39,795 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474899794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474899794"}]},"ts":"1696474899794"} 2023-10-05 03:01:39,795 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474899794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474899794"}]},"ts":"1696474899794"} 2023-10-05 03:01:39,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:01:39,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:01:39,797 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474899797"}]},"ts":"1696474899797"} 2023-10-05 03:01:39,799 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-05 03:01:39,801 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:01:39,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:01:39,802 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:01:39,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:01:39,803 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:01:39,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, ASSIGN}] 2023-10-05 03:01:39,805 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, ASSIGN 2023-10-05 03:01:39,805 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, ASSIGN 2023-10-05 03:01:39,806 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:01:39,806 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33679,1696474826205; forceNewPlan=false, retain=false 2023-10-05 03:01:39,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 03:01:39,956 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:01:39,959 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2a4436cf959515f774d04b5583a07385, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:39,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f67bf3d7135f9e14bbde8c996cdf2657, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:39,959 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474899959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474899959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474899959"}]},"ts":"1696474899959"} 2023-10-05 03:01:39,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474899959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474899959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474899959"}]},"ts":"1696474899959"} 2023-10-05 03:01:39,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 2a4436cf959515f774d04b5583a07385, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:01:39,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f67bf3d7135f9e14bbde8c996cdf2657, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:40,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 03:01:40,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f67bf3d7135f9e14bbde8c996cdf2657, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.', STARTKEY => '', ENDKEY => '2'} 2023-10-05 03:01:40,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a4436cf959515f774d04b5583a07385, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.', STARTKEY => '2', ENDKEY => ''} 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. service=AccessControlService 2023-10-05 03:01:40,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. service=AccessControlService 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:40,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,122 INFO [StoreOpener-f67bf3d7135f9e14bbde8c996cdf2657-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,122 INFO [StoreOpener-2a4436cf959515f774d04b5583a07385-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,123 DEBUG [StoreOpener-f67bf3d7135f9e14bbde8c996cdf2657-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf 2023-10-05 03:01:40,123 DEBUG [StoreOpener-f67bf3d7135f9e14bbde8c996cdf2657-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf 2023-10-05 03:01:40,123 DEBUG [StoreOpener-2a4436cf959515f774d04b5583a07385-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf 2023-10-05 03:01:40,123 DEBUG [StoreOpener-2a4436cf959515f774d04b5583a07385-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf 2023-10-05 03:01:40,123 INFO [StoreOpener-f67bf3d7135f9e14bbde8c996cdf2657-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f67bf3d7135f9e14bbde8c996cdf2657 columnFamilyName cf 2023-10-05 03:01:40,123 INFO [StoreOpener-2a4436cf959515f774d04b5583a07385-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a4436cf959515f774d04b5583a07385 columnFamilyName cf 2023-10-05 03:01:40,124 INFO [StoreOpener-f67bf3d7135f9e14bbde8c996cdf2657-1] regionserver.HStore(310): Store=f67bf3d7135f9e14bbde8c996cdf2657/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:40,124 INFO [StoreOpener-2a4436cf959515f774d04b5583a07385-1] regionserver.HStore(310): Store=2a4436cf959515f774d04b5583a07385/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:40,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:40,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:40,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a4436cf959515f774d04b5583a07385; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67799068, jitterRate=0.010284841060638428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:40,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f67bf3d7135f9e14bbde8c996cdf2657; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61843445, jitterRate=-0.07846085727214813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:40,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a4436cf959515f774d04b5583a07385: 2023-10-05 03:01:40,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f67bf3d7135f9e14bbde8c996cdf2657: 2023-10-05 03:01:40,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657., pid=70, masterSystemTime=1696474900113 2023-10-05 03:01:40,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385., pid=69, masterSystemTime=1696474900113 2023-10-05 03:01:40,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,133 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f67bf3d7135f9e14bbde8c996cdf2657, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:40,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,133 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474900133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474900133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474900133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474900133"}]},"ts":"1696474900133"} 2023-10-05 03:01:40,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=2a4436cf959515f774d04b5583a07385, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:40,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474900134"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474900134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474900134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474900134"}]},"ts":"1696474900134"} 2023-10-05 03:01:40,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-05 03:01:40,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f67bf3d7135f9e14bbde8c996cdf2657, server=jenkins-hbase4.apache.org,42403,1696474826248 in 173 msec 2023-10-05 03:01:40,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-05 03:01:40,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 2a4436cf959515f774d04b5583a07385, server=jenkins-hbase4.apache.org,33679,1696474826205 in 175 msec 2023-10-05 03:01:40,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, ASSIGN in 334 msec 2023-10-05 03:01:40,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-10-05 03:01:40,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, ASSIGN in 335 msec 2023-10-05 03:01:40,140 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:01:40,141 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474900141"}]},"ts":"1696474900141"} 2023-10-05 03:01:40,142 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-05 03:01:40,145 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:01:40,145 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-05 03:01:40,147 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 03:01:40,148 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:40,148 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:40,148 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:40,148 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:40,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 390 msec 2023-10-05 03:01:40,242 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 03:01:40,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 03:01:40,367 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-05 03:01:40,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f67bf3d7135f9e14bbde8c996cdf2657, 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f67bf3d7135f9e14bbde8c996cdf2657, 2a4436cf959515f774d04b5583a07385], force=true 2023-10-05 03:01:40,397 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f67bf3d7135f9e14bbde8c996cdf2657, 2a4436cf959515f774d04b5583a07385], force=true 2023-10-05 03:01:40,397 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f67bf3d7135f9e14bbde8c996cdf2657, 2a4436cf959515f774d04b5583a07385], force=true 2023-10-05 03:01:40,398 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f67bf3d7135f9e14bbde8c996cdf2657, 2a4436cf959515f774d04b5583a07385], force=true 2023-10-05 03:01:40,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 03:01:40,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, UNASSIGN}] 2023-10-05 03:01:40,419 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, UNASSIGN 2023-10-05 03:01:40,419 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, UNASSIGN 2023-10-05 03:01:40,420 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f67bf3d7135f9e14bbde8c996cdf2657, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:40,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2a4436cf959515f774d04b5583a07385, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:40,420 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474900420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474900420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474900420"}]},"ts":"1696474900420"} 2023-10-05 03:01:40,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474900420"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474900420"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474900420"}]},"ts":"1696474900420"} 2023-10-05 03:01:40,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure f67bf3d7135f9e14bbde8c996cdf2657, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:40,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 2a4436cf959515f774d04b5583a07385, server=jenkins-hbase4.apache.org,33679,1696474826205}] 2023-10-05 03:01:40,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 03:01:40,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f67bf3d7135f9e14bbde8c996cdf2657, disabling compactions & flushes 2023-10-05 03:01:40,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. after waiting 0 ms 2023-10-05 03:01:40,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f67bf3d7135f9e14bbde8c996cdf2657 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 03:01:40,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a4436cf959515f774d04b5583a07385, disabling compactions & flushes 2023-10-05 03:01:40,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. after waiting 0 ms 2023-10-05 03:01:40,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2a4436cf959515f774d04b5583a07385 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 03:01:40,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/.tmp/cf/e9c67f02701a43139d1e0abc967ff1fb 2023-10-05 03:01:40,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/.tmp/cf/bda872a0d0e5438990e870256dd52924 2023-10-05 03:01:40,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/.tmp/cf/bda872a0d0e5438990e870256dd52924 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf/bda872a0d0e5438990e870256dd52924 2023-10-05 03:01:40,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/.tmp/cf/e9c67f02701a43139d1e0abc967ff1fb as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf/e9c67f02701a43139d1e0abc967ff1fb 2023-10-05 03:01:40,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf/bda872a0d0e5438990e870256dd52924, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 03:01:40,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf/e9c67f02701a43139d1e0abc967ff1fb, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 03:01:40,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 2a4436cf959515f774d04b5583a07385 in 25ms, sequenceid=5, compaction requested=false 2023-10-05 03:01:40,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f67bf3d7135f9e14bbde8c996cdf2657 in 27ms, sequenceid=5, compaction requested=false 2023-10-05 03:01:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 03:01:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 03:01:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:40,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385. 2023-10-05 03:01:40,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a4436cf959515f774d04b5583a07385: 2023-10-05 03:01:40,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:40,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657. 2023-10-05 03:01:40,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f67bf3d7135f9e14bbde8c996cdf2657: 2023-10-05 03:01:40,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:40,614 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=2a4436cf959515f774d04b5583a07385, regionState=CLOSED 2023-10-05 03:01:40,615 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474900614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474900614"}]},"ts":"1696474900614"} 2023-10-05 03:01:40,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:40,615 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f67bf3d7135f9e14bbde8c996cdf2657, regionState=CLOSED 2023-10-05 03:01:40,615 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696474900615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474900615"}]},"ts":"1696474900615"} 2023-10-05 03:01:40,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-05 03:01:40,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 2a4436cf959515f774d04b5583a07385, server=jenkins-hbase4.apache.org,33679,1696474826205 in 194 msec 2023-10-05 03:01:40,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-05 03:01:40,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure f67bf3d7135f9e14bbde8c996cdf2657, server=jenkins-hbase4.apache.org,42403,1696474826248 in 196 msec 2023-10-05 03:01:40,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a4436cf959515f774d04b5583a07385, UNASSIGN in 201 msec 2023-10-05 03:01:40,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-05 03:01:40,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f67bf3d7135f9e14bbde8c996cdf2657, UNASSIGN in 203 msec 2023-10-05 03:01:40,665 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-05 03:01:40,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899759.f67bf3d7135f9e14bbde8c996cdf2657.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:40,668 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696474899759.2a4436cf959515f774d04b5583a07385.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:40,668 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:40,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 03:01:40,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, ASSIGN}] 2023-10-05 03:01:40,718 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, ASSIGN 2023-10-05 03:01:40,719 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:01:40,869 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 03:01:40,871 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=19595985428a968a585bd893e4952737, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:40,871 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696474900871"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474900871"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474900871"}]},"ts":"1696474900871"} 2023-10-05 03:01:40,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 19595985428a968a585bd893e4952737, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:41,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 03:01:41,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:41,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19595985428a968a585bd893e4952737, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.', STARTKEY => '', ENDKEY => ''} 2023-10-05 03:01:41,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. service=AccessControlService 2023-10-05 03:01:41,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:41,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 19595985428a968a585bd893e4952737 2023-10-05 03:01:41,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:41,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19595985428a968a585bd893e4952737 2023-10-05 03:01:41,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19595985428a968a585bd893e4952737 2023-10-05 03:01:41,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/.regioninfo 2023-10-05 03:01:41,038 INFO [StoreOpener-19595985428a968a585bd893e4952737-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19595985428a968a585bd893e4952737 2023-10-05 03:01:41,039 DEBUG [StoreOpener-19595985428a968a585bd893e4952737-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf 2023-10-05 03:01:41,039 DEBUG [StoreOpener-19595985428a968a585bd893e4952737-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf 2023-10-05 03:01:41,039 INFO [StoreOpener-19595985428a968a585bd893e4952737-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19595985428a968a585bd893e4952737 columnFamilyName cf 2023-10-05 03:01:41,065 DEBUG [StoreOpener-19595985428a968a585bd893e4952737-1] regionserver.HStore(539): loaded hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/bda872a0d0e5438990e870256dd52924.f67bf3d7135f9e14bbde8c996cdf2657->hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf/bda872a0d0e5438990e870256dd52924-top 2023-10-05 03:01:41,071 DEBUG [StoreOpener-19595985428a968a585bd893e4952737-1] regionserver.HStore(539): loaded hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/e9c67f02701a43139d1e0abc967ff1fb.2a4436cf959515f774d04b5583a07385->hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf/e9c67f02701a43139d1e0abc967ff1fb-top 2023-10-05 03:01:41,071 INFO [StoreOpener-19595985428a968a585bd893e4952737-1] regionserver.HStore(310): Store=19595985428a968a585bd893e4952737/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:41,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737 2023-10-05 03:01:41,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737 2023-10-05 03:01:41,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19595985428a968a585bd893e4952737 2023-10-05 03:01:41,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19595985428a968a585bd893e4952737; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63550845, jitterRate=-0.053018614649772644}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:41,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19595985428a968a585bd893e4952737: 2023-10-05 03:01:41,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737., pid=77, masterSystemTime=1696474901025 2023-10-05 03:01:41,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.,because compaction is disabled. 2023-10-05 03:01:41,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:41,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:41,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=19595985428a968a585bd893e4952737, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696474901080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474901080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474901080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474901080"}]},"ts":"1696474901080"} 2023-10-05 03:01:41,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-05 03:01:41,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 19595985428a968a585bd893e4952737, server=jenkins-hbase4.apache.org,42403,1696474826248 in 209 msec 2023-10-05 03:01:41,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-05 03:01:41,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, ASSIGN in 366 msec 2023-10-05 03:01:41,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f67bf3d7135f9e14bbde8c996cdf2657, 2a4436cf959515f774d04b5583a07385], force=true in 694 msec 2023-10-05 03:01:41,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 03:01:41,505 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-05 03:01:41,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 03:01:41,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474901506 (current time:1696474901506). 2023-10-05 03:01:41,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:41,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x758745cb to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:41,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76d71868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:41,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:41,515 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:41,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x758745cb to 127.0.0.1:56535 2023-10-05 03:01:41,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:41,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x7a2f777a to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35c9cce9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:41,524 DEBUG [hconnection-0x7b938660-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:41,526 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:41,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a2f777a to 127.0.0.1:56535 2023-10-05 03:01:41,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:41,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 03:01:41,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:41,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 03:01:41,534 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:41,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 03:01:41,536 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 03:01:41,536 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696475501536 2023-10-05 03:01:41,536 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 03:01:41,540 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:41,540 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:41,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 03:01:41,541 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 03:01:41,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-05 03:01:41,543 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 03:01:41,544 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696475501544 2023-10-05 03:01:41,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,552 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 03:01:41,552 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:41,554 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-05 03:01:41,554 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-05 03:01:41,554 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,554 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,555 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:41,555 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:41,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:41,555 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,555 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:41,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:41,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:41,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:41,556 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,556 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,557 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 03:01:41,557 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 03:01:41,557 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:41,557 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:41,558 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 03:01:41,559 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 03:01:41,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,559 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 03:01:41,559 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 03:01:41,560 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:41,559 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 03:01:41,560 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 03:01:41,561 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 03:01:41,561 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 03:01:41,561 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 03:01:41,561 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 03:01:41,562 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,562 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,562 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:41,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:41,564 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,565 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-05 03:01:41,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51a82087[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:41,566 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-05 03:01:41,566 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,567 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,567 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,567 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 03:01:41,567 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,568 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 03:01:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:41,568 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:41,568 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:41,568 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. started... 2023-10-05 03:01:41,569 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19595985428a968a585bd893e4952737: 2023-10-05 03:01:41,569 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,570 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:41,570 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/bda872a0d0e5438990e870256dd52924.f67bf3d7135f9e14bbde8c996cdf2657->hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf/bda872a0d0e5438990e870256dd52924-top, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/e9c67f02701a43139d1e0abc967ff1fb.2a4436cf959515f774d04b5583a07385->hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf/e9c67f02701a43139d1e0abc967ff1fb-top] hfiles 2023-10-05 03:01:41,570 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/bda872a0d0e5438990e870256dd52924.f67bf3d7135f9e14bbde8c996cdf2657 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,570 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 03:01:41,570 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:41,570 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 03:01:41,571 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/e9c67f02701a43139d1e0abc967ff1fb.2a4436cf959515f774d04b5583a07385 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 03:01:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:41,571 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 03:01:41,589 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. completed. 2023-10-05 03:01:41,589 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:41,589 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:41,589 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:41,589 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,589 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 03:01:41,590 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 03:01:41,595 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:41,595 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 03:01:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:41,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-05 03:01:41,598 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-05 03:01:41,598 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:41,598 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:41,598 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,598 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:41,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:41,600 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:41,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,599 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:41,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,600 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:41,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,600 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:41,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:41,601 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:41,603 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,603 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,603 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:41,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:41,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:41,607 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:41,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:41,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:41,606 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,607 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:41,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,607 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,607 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:41,607 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:41,607 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:41,607 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,608 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:41,608 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:41,608 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,608 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-05 03:01:41,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,630 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696474901536Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696474901607 (+71 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696474901607Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696474901610 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696474901622 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696474901629 (+7 ms) 2023-10-05 03:01:41,633 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 03:01:41,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-10-05 03:01:41,640 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:41,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 03:01:41,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:41,641 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641 2023-10-05 03:01:41,642 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34213, tgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641, rawTgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:41,663 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:41,663 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1771408823_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,664 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-05 03:01:41,672 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:41,689 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:41,690 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:41,690 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:41,690 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,558 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-8975022641325668171.jar 2023-10-05 03:01:42,558 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,558 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,624 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-6594264043573038964.jar 2023-10-05 03:01:42,625 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,625 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,626 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,626 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,626 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,627 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:42,627 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:01:42,628 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:01:42,628 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:01:42,629 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:01:42,629 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:01:42,629 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:01:42,630 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:01:42,630 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:01:42,630 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:01:42,631 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:01:42,631 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:42,632 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:42,632 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:42,633 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:42,633 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:42,633 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:42,634 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:42,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0004_000001 (auth:SIMPLE) 2023-10-05 03:01:42,991 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:01:42,994 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-05 03:01:42,995 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-05 03:01:43,044 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:43,044 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:43,672 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:01:43,716 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0005_000001 (auth:SIMPLE) 2023-10-05 03:01:47,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0005_000001 (auth:SIMPLE) 2023-10-05 03:01:49,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0005_000001 (auth:SIMPLE) 2023-10-05 03:01:52,273 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0005_000001 (auth:SIMPLE) 2023-10-05 03:01:54,150 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:01:54,153 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:01:54,162 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,162 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:01:54,162 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:01:54,162 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,163 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 03:01:54,163 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 03:01:54,163 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,164 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 03:01:54,164 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474901641/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 03:01:54,170 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 03:01:54,175 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474914175"}]},"ts":"1696474914175"} 2023-10-05 03:01:54,176 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-05 03:01:54,178 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-05 03:01:54,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, UNASSIGN}] 2023-10-05 03:01:54,180 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, UNASSIGN 2023-10-05 03:01:54,181 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=19595985428a968a585bd893e4952737, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:54,181 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696474914181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474914181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474914181"}]},"ts":"1696474914181"} 2023-10-05 03:01:54,182 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 19595985428a968a585bd893e4952737, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:54,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 03:01:54,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 19595985428a968a585bd893e4952737 2023-10-05 03:01:54,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19595985428a968a585bd893e4952737, disabling compactions & flushes 2023-10-05 03:01:54,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:54,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:54,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. after waiting 0 ms 2023-10-05 03:01:54,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:54,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-05 03:01:54,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:54,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737. 2023-10-05 03:01:54,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19595985428a968a585bd893e4952737: 2023-10-05 03:01:54,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 19595985428a968a585bd893e4952737 2023-10-05 03:01:54,349 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=19595985428a968a585bd893e4952737, regionState=CLOSED 2023-10-05 03:01:54,349 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696474914349"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474914349"}]},"ts":"1696474914349"} 2023-10-05 03:01:54,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-05 03:01:54,352 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 19595985428a968a585bd893e4952737, server=jenkins-hbase4.apache.org,42403,1696474826248 in 168 msec 2023-10-05 03:01:54,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-05 03:01:54,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=19595985428a968a585bd893e4952737, UNASSIGN in 174 msec 2023-10-05 03:01:54,354 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474914354"}]},"ts":"1696474914354"} 2023-10-05 03:01:54,355 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-05 03:01:54,357 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-05 03:01:54,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-10-05 03:01:54,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 03:01:54,477 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-05 03:01:54,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,482 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,485 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:54,485 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:54,485 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737 2023-10-05 03:01:54,486 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,486 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,486 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,486 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 03:01:54,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 03:01:54,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 03:01:54,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 03:01:54,488 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/recovered.edits] 2023-10-05 03:01:54,488 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/recovered.edits] 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,488 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,489 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/recovered.edits] 2023-10-05 03:01:54,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 03:01:54,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:54,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:54,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:54,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:54,493 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf/e9c67f02701a43139d1e0abc967ff1fb to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/cf/e9c67f02701a43139d1e0abc967ff1fb 2023-10-05 03:01:54,493 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/bda872a0d0e5438990e870256dd52924.f67bf3d7135f9e14bbde8c996cdf2657 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/bda872a0d0e5438990e870256dd52924.f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:54,493 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf/bda872a0d0e5438990e870256dd52924 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/cf/bda872a0d0e5438990e870256dd52924 2023-10-05 03:01:54,495 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/e9c67f02701a43139d1e0abc967ff1fb.2a4436cf959515f774d04b5583a07385 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/cf/e9c67f02701a43139d1e0abc967ff1fb.2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:54,497 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/recovered.edits/8.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385/recovered.edits/8.seqid 2023-10-05 03:01:54,497 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/recovered.edits/8.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657/recovered.edits/8.seqid 2023-10-05 03:01:54,498 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a4436cf959515f774d04b5583a07385 2023-10-05 03:01:54,498 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f67bf3d7135f9e14bbde8c996cdf2657 2023-10-05 03:01:54,498 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/recovered.edits/12.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737/recovered.edits/12.seqid 2023-10-05 03:01:54,499 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/19595985428a968a585bd893e4952737 2023-10-05 03:01:54,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 03:01:54,501 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,503 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-05 03:01:54,505 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-05 03:01:54,506 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,506 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-05 03:01:54,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474914506"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:54,507 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-05 03:01:54,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 19595985428a968a585bd893e4952737, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696474899760.19595985428a968a585bd893e4952737.', STARTKEY => '', ENDKEY => ''}] 2023-10-05 03:01:54,507 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-05 03:01:54,508 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474914507"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:54,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-05 03:01:54,510 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:54,511 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 32 msec 2023-10-05 03:01:54,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 03:01:54,590 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-05 03:01:54,591 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 03:01:54,595 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474914595"}]},"ts":"1696474914595"} 2023-10-05 03:01:54,597 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-05 03:01:54,598 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-05 03:01:54,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, UNASSIGN}] 2023-10-05 03:01:54,601 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, UNASSIGN 2023-10-05 03:01:54,601 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, UNASSIGN 2023-10-05 03:01:54,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9526df8401555887dd260f5b453ef789, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:54,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=70fc575e078a0ba026f4699963140a0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:54,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474914601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474914601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474914601"}]},"ts":"1696474914601"} 2023-10-05 03:01:54,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474914601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474914601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474914601"}]},"ts":"1696474914601"} 2023-10-05 03:01:54,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 9526df8401555887dd260f5b453ef789, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:54,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 70fc575e078a0ba026f4699963140a0b, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:01:54,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 03:01:54,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:54,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9526df8401555887dd260f5b453ef789, disabling compactions & flushes 2023-10-05 03:01:54,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:54,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:54,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. after waiting 0 ms 2023-10-05 03:01:54,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:54,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:54,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 70fc575e078a0ba026f4699963140a0b, disabling compactions & flushes 2023-10-05 03:01:54,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:54,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:54,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. after waiting 0 ms 2023-10-05 03:01:54,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:54,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:01:54,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:54,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789. 2023-10-05 03:01:54,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9526df8401555887dd260f5b453ef789: 2023-10-05 03:01:54,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:01:54,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:01:54,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b. 2023-10-05 03:01:54,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 70fc575e078a0ba026f4699963140a0b: 2023-10-05 03:01:54,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9526df8401555887dd260f5b453ef789 2023-10-05 03:01:54,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9526df8401555887dd260f5b453ef789, regionState=CLOSED 2023-10-05 03:01:54,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474914773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474914773"}]},"ts":"1696474914773"} 2023-10-05 03:01:54,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:54,774 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=70fc575e078a0ba026f4699963140a0b, regionState=CLOSED 2023-10-05 03:01:54,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696474914774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474914774"}]},"ts":"1696474914774"} 2023-10-05 03:01:54,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-05 03:01:54,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 9526df8401555887dd260f5b453ef789, server=jenkins-hbase4.apache.org,42403,1696474826248 in 171 msec 2023-10-05 03:01:54,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-05 03:01:54,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 70fc575e078a0ba026f4699963140a0b, server=jenkins-hbase4.apache.org,39035,1696474826157 in 173 msec 2023-10-05 03:01:54,777 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9526df8401555887dd260f5b453ef789, UNASSIGN in 177 msec 2023-10-05 03:01:54,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-05 03:01:54,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=70fc575e078a0ba026f4699963140a0b, UNASSIGN in 178 msec 2023-10-05 03:01:54,779 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474914779"}]},"ts":"1696474914779"} 2023-10-05 03:01:54,780 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-05 03:01:54,782 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-05 03:01:54,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-10-05 03:01:54,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 03:01:54,898 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-05 03:01:54,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,901 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,902 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,903 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,906 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,906 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,906 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,906 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 03:01:54,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 03:01:54,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 03:01:54,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 03:01:54,907 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 2023-10-05 03:01:54,907 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,907 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:54,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 03:01:54,909 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/recovered.edits] 2023-10-05 03:01:54,909 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/recovered.edits] 2023-10-05 03:01:54,913 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf/2e09205e5f8243c9878cafa50057acd5 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/cf/2e09205e5f8243c9878cafa50057acd5 2023-10-05 03:01:54,913 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf/9c7d8b8e92e643da9dbffa315ce56e69 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/cf/9c7d8b8e92e643da9dbffa315ce56e69 2023-10-05 03:01:54,915 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789/recovered.edits/9.seqid 2023-10-05 03:01:54,915 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b/recovered.edits/9.seqid 2023-10-05 03:01:54,916 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9526df8401555887dd260f5b453ef789 2023-10-05 03:01:54,916 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/70fc575e078a0ba026f4699963140a0b 2023-10-05 03:01:54,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 03:01:54,917 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 03:01:54,917 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-05 03:01:54,921 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005c597f87f16664ab6b986f4878453bd86 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005c597f87f16664ab6b986f4878453bd86 2023-10-05 03:01:54,922 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005747361227b1e49e99cadf950033e05b3 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231005747361227b1e49e99cadf950033e05b3 2023-10-05 03:01:54,922 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 03:01:54,925 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,927 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-05 03:01:54,928 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-05 03:01:54,929 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,929 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-05 03:01:54,929 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474914929"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:54,930 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474914929"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:54,931 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 03:01:54,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9526df8401555887dd260f5b453ef789, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696474898391.9526df8401555887dd260f5b453ef789.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 70fc575e078a0ba026f4699963140a0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696474898391.70fc575e078a0ba026f4699963140a0b.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 03:01:54,931 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-05 03:01:54,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474914931"}]},"ts":"9223372036854775807"} 2023-10-05 03:01:54,932 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-05 03:01:54,936 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:54,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 38 msec 2023-10-05 03:01:55,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 03:01:55,010 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-05 03:01:55,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 03:01:55,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:55,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 03:01:55,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 03:01:55,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-05 03:01:55,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 03:01:55,049 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 752) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3959 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:56328 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:47006 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:41746 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:35847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1679770401_1 at /127.0.0.1:56298 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=132 (was 161), ProcessCount=167 (was 167), AvailableMemoryMB=5769 (was 5914) 2023-10-05 03:01:55,050 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-05 03:01:55,068 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=132, ProcessCount=167, AvailableMemoryMB=5768 2023-10-05 03:01:55,068 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-05 03:01:55,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 03:01:55,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:01:55,073 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:01:55,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-05 03:01:55,073 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:01:55,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 03:01:55,075 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,075 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,076 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b empty. 2023-10-05 03:01:55,076 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 empty. 2023-10-05 03:01:55,076 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,076 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,076 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 03:01:55,111 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 03:01:55,113 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6b67cd847b5b5659e6b62b68a144f2b, NAME => 'testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:55,113 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7051543edbe31e719cd7ab112d763243, NAME => 'testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7051543edbe31e719cd7ab112d763243, disabling compactions & flushes 2023-10-05 03:01:55,127 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. after waiting 0 ms 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e6b67cd847b5b5659e6b62b68a144f2b, disabling compactions & flushes 2023-10-05 03:01:55,127 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,128 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,128 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,128 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,128 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. after waiting 0 ms 2023-10-05 03:01:55,128 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7051543edbe31e719cd7ab112d763243: 2023-10-05 03:01:55,128 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,128 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,128 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e6b67cd847b5b5659e6b62b68a144f2b: 2023-10-05 03:01:55,130 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:01:55,131 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474915130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474915130"}]},"ts":"1696474915130"} 2023-10-05 03:01:55,131 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474915130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474915130"}]},"ts":"1696474915130"} 2023-10-05 03:01:55,132 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:01:55,133 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:01:55,133 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474915133"}]},"ts":"1696474915133"} 2023-10-05 03:01:55,134 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 03:01:55,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:01:55,138 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:01:55,138 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:01:55,138 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:01:55,138 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:01:55,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, ASSIGN}] 2023-10-05 03:01:55,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, ASSIGN 2023-10-05 03:01:55,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, ASSIGN 2023-10-05 03:01:55,140 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39035,1696474826157; forceNewPlan=false, retain=false 2023-10-05 03:01:55,141 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:01:55,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 03:01:55,291 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:01:55,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e6b67cd847b5b5659e6b62b68a144f2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,293 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7051543edbe31e719cd7ab112d763243, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474915293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474915293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474915293"}]},"ts":"1696474915293"} 2023-10-05 03:01:55,294 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474915293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474915293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474915293"}]},"ts":"1696474915293"} 2023-10-05 03:01:55,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure e6b67cd847b5b5659e6b62b68a144f2b, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:01:55,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 7051543edbe31e719cd7ab112d763243, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:01:55,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 03:01:55,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6b67cd847b5b5659e6b62b68a144f2b, NAME => 'testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 03:01:55,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. service=AccessControlService 2023-10-05 03:01:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7051543edbe31e719cd7ab112d763243, NAME => 'testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 03:01:55,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. service=AccessControlService 2023-10-05 03:01:55,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,452 INFO [StoreOpener-7051543edbe31e719cd7ab112d763243-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,452 INFO [StoreOpener-e6b67cd847b5b5659e6b62b68a144f2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,453 DEBUG [StoreOpener-7051543edbe31e719cd7ab112d763243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf 2023-10-05 03:01:55,453 DEBUG [StoreOpener-e6b67cd847b5b5659e6b62b68a144f2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf 2023-10-05 03:01:55,453 DEBUG [StoreOpener-7051543edbe31e719cd7ab112d763243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf 2023-10-05 03:01:55,453 DEBUG [StoreOpener-e6b67cd847b5b5659e6b62b68a144f2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf 2023-10-05 03:01:55,454 INFO [StoreOpener-7051543edbe31e719cd7ab112d763243-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7051543edbe31e719cd7ab112d763243 columnFamilyName cf 2023-10-05 03:01:55,454 INFO [StoreOpener-e6b67cd847b5b5659e6b62b68a144f2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6b67cd847b5b5659e6b62b68a144f2b columnFamilyName cf 2023-10-05 03:01:55,455 INFO [StoreOpener-e6b67cd847b5b5659e6b62b68a144f2b-1] regionserver.HStore(310): Store=e6b67cd847b5b5659e6b62b68a144f2b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:55,455 INFO [StoreOpener-7051543edbe31e719cd7ab112d763243-1] regionserver.HStore(310): Store=7051543edbe31e719cd7ab112d763243/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:01:55,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:01:55,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7051543edbe31e719cd7ab112d763243 2023-10-05 03:01:55,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:55,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:01:55,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7051543edbe31e719cd7ab112d763243; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71992324, jitterRate=0.07276922464370728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:55,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e6b67cd847b5b5659e6b62b68a144f2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75246632, jitterRate=0.12126219272613525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:01:55,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7051543edbe31e719cd7ab112d763243: 2023-10-05 03:01:55,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e6b67cd847b5b5659e6b62b68a144f2b: 2023-10-05 03:01:55,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243., pid=94, masterSystemTime=1696474915447 2023-10-05 03:01:55,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b., pid=93, masterSystemTime=1696474915447 2023-10-05 03:01:55,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,465 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=7051543edbe31e719cd7ab112d763243, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474915465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474915465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474915465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474915465"}]},"ts":"1696474915465"} 2023-10-05 03:01:55,465 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e6b67cd847b5b5659e6b62b68a144f2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,466 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474915465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474915465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474915465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474915465"}]},"ts":"1696474915465"} 2023-10-05 03:01:55,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-05 03:01:55,468 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 7051543edbe31e719cd7ab112d763243, server=jenkins-hbase4.apache.org,39035,1696474826157 in 170 msec 2023-10-05 03:01:55,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-05 03:01:55,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure e6b67cd847b5b5659e6b62b68a144f2b, server=jenkins-hbase4.apache.org,42403,1696474826248 in 172 msec 2023-10-05 03:01:55,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, ASSIGN in 330 msec 2023-10-05 03:01:55,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-05 03:01:55,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, ASSIGN in 331 msec 2023-10-05 03:01:55,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:01:55,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474915471"}]},"ts":"1696474915471"} 2023-10-05 03:01:55,472 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 03:01:55,475 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:01:55,475 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-05 03:01:55,477 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 03:01:55,479 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:55,479 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:55,479 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:55,479 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:01:55,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:55,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:55,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:55,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 03:01:55,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 410 msec 2023-10-05 03:01:55,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 03:01:55,676 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-05 03:01:55,679 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 03:01:55,679 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,680 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:01:55,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:01:55,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474915691 (current time:1696474915691). 2023-10-05 03:01:55,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:55,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x353ae8b4 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:55,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42629ac8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:55,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:55,704 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:55,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x353ae8b4 to 127.0.0.1:56535 2023-10-05 03:01:55,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:55,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x35c554e9 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:55,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@575875ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:55,712 DEBUG [hconnection-0x13a1154-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:55,713 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:55,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35c554e9 to 127.0.0.1:56535 2023-10-05 03:01:55,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:55,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 03:01:55,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:55,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:01:55,721 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:55,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:01:55,725 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:01:55,726 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696475515726 2023-10-05 03:01:55,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:01:55,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 03:01:55,727 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:55,727 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:55,728 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:01:55,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 03:01:55,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 03:01:55,731 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 03:01:55,732 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696475515732 2023-10-05 03:01:55,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,741 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-05 03:01:55,741 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:55,742 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 03:01:55,742 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 03:01:55,743 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,743 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,750 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:55,750 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:55,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:55,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:55,750 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,750 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:55,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,751 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 03:01:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 03:01:55,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 03:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 03:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 03:01:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 03:01:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 03:01:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 03:01:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 03:01:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 03:01:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 03:01:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 03:01:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 03:01:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,757 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,757 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:55,757 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,757 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:55,757 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,757 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:55,758 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:55,759 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,759 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73427b7d[Count = 1] remaining members to acquire global barrier 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 03:01:55,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73427b7d[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:55,763 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 03:01:55,763 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,766 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:01:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:01:55,766 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,766 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. started... 2023-10-05 03:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. started... 2023-10-05 03:01:55,766 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6b67cd847b5b5659e6b62b68a144f2b: 2023-10-05 03:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7051543edbe31e719cd7ab112d763243: 2023-10-05 03:01:55,767 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,768 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 03:01:55,768 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:55,768 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:55,768 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:01:55,768 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:01:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 03:01:55,789 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. completed. 2023-10-05 03:01:55,789 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,790 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 03:01:55,790 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 03:01:55,792 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:55,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:55,792 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 03:01:55,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:55,795 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. completed. 2023-10-05 03:01:55,795 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:55,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:55,795 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:55,795 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:55,795 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,795 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 03:01:55,795 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,797 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 03:01:55,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,797 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,797 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:55,797 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 03:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:55,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:55,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:55,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 03:01:55,804 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 03:01:55,804 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:55,804 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:55,804 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,804 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:55,809 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:55,809 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:55,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:55,810 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:55,810 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:55,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:55,811 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,811 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:55,813 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,814 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,814 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:55,817 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:55,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:55,817 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,817 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:55,819 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 03:01:55,819 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:55,819 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:55,819 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:55,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:01:55,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:55,819 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:55,820 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:55,820 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,820 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:55,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 03:01:55,827 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:55,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:01:55,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:01:55,828 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:01:55,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 03:01:55,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,865 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:55,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696474915726Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696474915836 (+110 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696474915836Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696474915836Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696474915845 (+9 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696474915857 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696474915864 (+7 ms) 2023-10-05 03:01:55,868 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 03:01:55,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 141 msec 2023-10-05 03:01:56,028 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:56,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:01:56,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:56,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:01:56,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39035] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:01:56,036 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 03:01:56,036 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:56,036 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:01:56,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:01:56,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474916045 (current time:1696474916045). 2023-10-05 03:01:56,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:01:56,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x62d37139 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:56,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28226af7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:56,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:56,056 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:56,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62d37139 to 127.0.0.1:56535 2023-10-05 03:01:56,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:56,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x7198030f to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:01:56,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@83beebc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:01:56,064 DEBUG [hconnection-0x3375589e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:01:56,067 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:01:56,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7198030f to 127.0.0.1:56535 2023-10-05 03:01:56,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:01:56,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 03:01:56,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:01:56,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:01:56,074 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:01:56,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:01:56,076 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:01:56,077 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696475516077 2023-10-05 03:01:56,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 03:01:56,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 03:01:56,078 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:01:56,078 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:01:56,079 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 03:01:56,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 03:01:56,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 03:01:56,081 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 03:01:56,082 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696475516082 2023-10-05 03:01:56,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,090 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-05 03:01:56,090 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:56,091 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 03:01:56,091 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 03:01:56,091 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,091 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,092 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:56,092 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:56,092 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:56,092 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:56,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:56,093 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,093 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,093 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,093 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 03:01:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:56,095 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 03:01:56,096 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 03:01:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 03:01:56,096 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 03:01:56,096 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 03:01:56,096 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 03:01:56,096 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 03:01:56,096 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:01:56,099 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 03:01:56,099 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 03:01:56,099 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 03:01:56,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,101 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:56,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:56,101 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,101 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,101 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,102 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:56,101 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:56,102 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,102 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:56,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:56,102 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,102 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:01:56,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:56,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d3fef54[Count = 1] remaining members to acquire global barrier 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:56,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 03:01:56,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d3fef54[Count = 0] remaining members to acquire global barrier 2023-10-05 03:01:56,105 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 03:01:56,105 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,110 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,110 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,110 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,111 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 03:01:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:01:56,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,111 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,111 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:01:56,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 03:01:56,111 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:56,111 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. started... 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:01:56,111 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:01:56,111 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:56,111 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e6b67cd847b5b5659e6b62b68a144f2b 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 03:01:56,111 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. started... 2023-10-05 03:01:56,112 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7051543edbe31e719cd7ab112d763243 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 03:01:56,113 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 03:01:56,113 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:56,113 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 03:01:56,128 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023100539d07bbda8fa4f4e9ccb9079c2b9341e to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100539d07bbda8fa4f4e9ccb9079c2b9341e 2023-10-05 03:01:56,129 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310056a69726600d645a293b97e3ef1984ce7 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310056a69726600d645a293b97e3ef1984ce7 2023-10-05 03:01:56,138 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/.tmp/cf/adcd4032f12c4af3a6a2fb9ff0297728 2023-10-05 03:01:56,140 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/.tmp/cf/2dc47de2717840bd8929383130309811 2023-10-05 03:01:56,143 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/.tmp/cf/adcd4032f12c4af3a6a2fb9ff0297728 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf/adcd4032f12c4af3a6a2fb9ff0297728 2023-10-05 03:01:56,146 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/.tmp/cf/2dc47de2717840bd8929383130309811 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf/2dc47de2717840bd8929383130309811 2023-10-05 03:01:56,148 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf/adcd4032f12c4af3a6a2fb9ff0297728, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 03:01:56,149 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e6b67cd847b5b5659e6b62b68a144f2b in 38ms, sequenceid=6, compaction requested=false 2023-10-05 03:01:56,149 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 03:01:56,149 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6b67cd847b5b5659e6b62b68a144f2b: 2023-10-05 03:01:56,150 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,150 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:56,150 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf/adcd4032f12c4af3a6a2fb9ff0297728] hfiles 2023-10-05 03:01:56,150 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf/adcd4032f12c4af3a6a2fb9ff0297728 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,151 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf/2dc47de2717840bd8929383130309811, entries=47, sequenceid=6, filesize=13.1 K 2023-10-05 03:01:56,151 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7051543edbe31e719cd7ab112d763243 in 39ms, sequenceid=6, compaction requested=false 2023-10-05 03:01:56,153 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7051543edbe31e719cd7ab112d763243: 2023-10-05 03:01:56,153 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,154 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:01:56,154 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf/2dc47de2717840bd8929383130309811] hfiles 2023-10-05 03:01:56,154 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf/2dc47de2717840bd8929383130309811 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,160 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. completed. 2023-10-05 03:01:56,160 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:01:56,160 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 03:01:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:01:56,162 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,162 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 03:01:56,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:56,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:56,162 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:56,163 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 03:01:56,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:56,164 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. completed. 2023-10-05 03:01:56,164 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:01:56,164 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:01:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:01:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 03:01:56,165 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:01:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,170 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 03:01:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:56,170 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 03:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:01:56,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:01:56,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 03:01:56,176 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 03:01:56,176 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:01:56,176 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:01:56,176 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,176 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:56,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:56,179 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:01:56,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,178 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:56,179 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:56,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:56,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:01:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:01:56,180 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,180 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:01:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:01:56,182 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,182 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,182 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,184 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:56,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:56,185 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:56,186 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:01:56,185 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:01:56,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:56,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 03:01:56,186 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:01:56,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:01:56,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:01:56,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:56,186 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:01:56,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,186 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:01:56,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:56,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:01:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:01:56,187 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310056a69726600d645a293b97e3ef1984ce7, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100539d07bbda8fa4f4e9ccb9079c2b9341e] mob files 2023-10-05 03:01:56,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310056a69726600d645a293b97e3ef1984ce7 2023-10-05 03:01:56,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100539d07bbda8fa4f4e9ccb9079c2b9341e 2023-10-05 03:01:56,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 03:01:56,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,218 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696474916077Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696474916194 (+117 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696474916194Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696474916194Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696474916199 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696474916210 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696474916217 (+7 ms) 2023-10-05 03:01:56,221 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 03:01:56,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 143 msec 2023-10-05 03:01:56,380 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:01:56,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 03:01:56,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:01:56,382 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382 2023-10-05 03:01:56,382 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34213, tgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382, rawTgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:56,403 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:01:56,404 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1332980128_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,404 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-05 03:01:56,409 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:01:56,430 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:56,431 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:56,431 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:56,431 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,302 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-9179172183278924141.jar 2023-10-05 03:01:57,302 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,302 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,368 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-8398690421820492686.jar 2023-10-05 03:01:57,369 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,369 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,370 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,370 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,370 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,370 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:01:57,371 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:01:57,371 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:01:57,371 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:01:57,372 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:01:57,372 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:01:57,373 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:01:57,373 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:01:57,373 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:01:57,374 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:01:57,374 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:01:57,375 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:57,375 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:57,376 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:57,376 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:57,376 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:01:57,376 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:57,377 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:01:57,767 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:01:57,770 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-05 03:01:58,446 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:58,446 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:01:58,448 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0005_000001 (auth:SIMPLE) 2023-10-05 03:01:58,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0006_000001 (auth:SIMPLE) 2023-10-05 03:01:59,933 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:02:02,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0006_000001 (auth:SIMPLE) 2023-10-05 03:02:05,104 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:02:05,105 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:02:05,110 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:02:05,110 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:02:05,111 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:02:05,111 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:02:05,111 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 03:02:05,111 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 03:02:05,111 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:02:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 03:02:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474916382/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 03:02:05,116 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 03:02:05,121 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474925121"}]},"ts":"1696474925121"} 2023-10-05 03:02:05,122 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 03:02:05,124 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-05 03:02:05,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, UNASSIGN}] 2023-10-05 03:02:05,130 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, UNASSIGN 2023-10-05 03:02:05,130 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, UNASSIGN 2023-10-05 03:02:05,131 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7051543edbe31e719cd7ab112d763243, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:05,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e6b67cd847b5b5659e6b62b68a144f2b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:05,131 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474925131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474925131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474925131"}]},"ts":"1696474925131"} 2023-10-05 03:02:05,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474925131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474925131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474925131"}]},"ts":"1696474925131"} 2023-10-05 03:02:05,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure e6b67cd847b5b5659e6b62b68a144f2b, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:02:05,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 7051543edbe31e719cd7ab112d763243, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:02:05,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 03:02:05,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7051543edbe31e719cd7ab112d763243 2023-10-05 03:02:05,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7051543edbe31e719cd7ab112d763243, disabling compactions & flushes 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e6b67cd847b5b5659e6b62b68a144f2b, disabling compactions & flushes 2023-10-05 03:02:05,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:02:05,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. after waiting 0 ms 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. after waiting 0 ms 2023-10-05 03:02:05,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:02:05,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:02:05,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:02:05,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:05,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:05,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243. 2023-10-05 03:02:05,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b. 2023-10-05 03:02:05,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7051543edbe31e719cd7ab112d763243: 2023-10-05 03:02:05,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e6b67cd847b5b5659e6b62b68a144f2b: 2023-10-05 03:02:05,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:02:05,298 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e6b67cd847b5b5659e6b62b68a144f2b, regionState=CLOSED 2023-10-05 03:02:05,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7051543edbe31e719cd7ab112d763243 2023-10-05 03:02:05,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474925298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474925298"}]},"ts":"1696474925298"} 2023-10-05 03:02:05,298 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=7051543edbe31e719cd7ab112d763243, regionState=CLOSED 2023-10-05 03:02:05,299 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696474925298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474925298"}]},"ts":"1696474925298"} 2023-10-05 03:02:05,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-05 03:02:05,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure e6b67cd847b5b5659e6b62b68a144f2b, server=jenkins-hbase4.apache.org,42403,1696474826248 in 168 msec 2023-10-05 03:02:05,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-05 03:02:05,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 7051543edbe31e719cd7ab112d763243, server=jenkins-hbase4.apache.org,39035,1696474826157 in 166 msec 2023-10-05 03:02:05,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6b67cd847b5b5659e6b62b68a144f2b, UNASSIGN in 177 msec 2023-10-05 03:02:05,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-05 03:02:05,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7051543edbe31e719cd7ab112d763243, UNASSIGN in 178 msec 2023-10-05 03:02:05,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474925305"}]},"ts":"1696474925305"} 2023-10-05 03:02:05,307 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 03:02:05,308 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-05 03:02:05,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 192 msec 2023-10-05 03:02:05,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 03:02:05,424 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-05 03:02:05,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,428 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,430 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,434 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:02:05,434 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 2023-10-05 03:02:05,434 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,434 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,434 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,434 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 03:02:05,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 03:02:05,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 03:02:05,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 03:02:05,436 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,436 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,436 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,437 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,437 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,437 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,437 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/recovered.edits] 2023-10-05 03:02:05,437 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/recovered.edits] 2023-10-05 03:02:05,437 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,437 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 03:02:05,442 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf/adcd4032f12c4af3a6a2fb9ff0297728 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/cf/adcd4032f12c4af3a6a2fb9ff0297728 2023-10-05 03:02:05,442 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf/2dc47de2717840bd8929383130309811 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/cf/2dc47de2717840bd8929383130309811 2023-10-05 03:02:05,445 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b/recovered.edits/9.seqid 2023-10-05 03:02:05,445 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243/recovered.edits/9.seqid 2023-10-05 03:02:05,445 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6b67cd847b5b5659e6b62b68a144f2b 2023-10-05 03:02:05,446 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testEmptyExportFileSystemState/7051543edbe31e719cd7ab112d763243 2023-10-05 03:02:05,446 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 03:02:05,446 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 03:02:05,447 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-05 03:02:05,450 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310056a69726600d645a293b97e3ef1984ce7 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202310056a69726600d645a293b97e3ef1984ce7 2023-10-05 03:02:05,451 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100539d07bbda8fa4f4e9ccb9079c2b9341e to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023100539d07bbda8fa4f4e9ccb9079c2b9341e 2023-10-05 03:02:05,451 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 03:02:05,453 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,455 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-05 03:02:05,458 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-05 03:02:05,458 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,458 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-05 03:02:05,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474925459"}]},"ts":"9223372036854775807"} 2023-10-05 03:02:05,459 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474925459"}]},"ts":"9223372036854775807"} 2023-10-05 03:02:05,460 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 03:02:05,460 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e6b67cd847b5b5659e6b62b68a144f2b, NAME => 'testtb-testEmptyExportFileSystemState,,1696474915069.e6b67cd847b5b5659e6b62b68a144f2b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7051543edbe31e719cd7ab112d763243, NAME => 'testtb-testEmptyExportFileSystemState,1,1696474915069.7051543edbe31e719cd7ab112d763243.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 03:02:05,460 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-05 03:02:05,460 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474925460"}]},"ts":"9223372036854775807"} 2023-10-05 03:02:05,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-05 03:02:05,464 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 03:02:05,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-10-05 03:02:05,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 03:02:05,539 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-05 03:02:05,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-05 03:02:05,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 03:02:05,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-05 03:02:05,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-05 03:02:05,577 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 757) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:37919 from appattempt_1696474832679_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:45049 from appattempt_1696474832679_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:38755 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4612 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:57634 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:43348 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1829237526_1 at /127.0.0.1:57606 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x18d0c61c-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1646300037_17 at /127.0.0.1:58726 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1829237526_1 at /127.0.0.1:43276 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=939 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=119 (was 132), ProcessCount=167 (was 167), AvailableMemoryMB=5698 (was 5768) 2023-10-05 03:02:05,577 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 03:02:05,598 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=119, ProcessCount=167, AvailableMemoryMB=5736 2023-10-05 03:02:05,598 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 03:02:05,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 03:02:05,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:05,603 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 03:02:05,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-05 03:02:05,603 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 03:02:05,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 03:02:05,606 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,606 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,606 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 empty. 2023-10-05 03:02:05,606 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 empty. 2023-10-05 03:02:05,606 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,607 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,607 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 03:02:05,620 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-05 03:02:05,621 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a102b5e2a5889c9f85511bdc3f69bf6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:02:05,622 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 867ba937699a9e99f00acb0eb75e7fa0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp 2023-10-05 03:02:05,641 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:02:05,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7a102b5e2a5889c9f85511bdc3f69bf6, disabling compactions & flushes 2023-10-05 03:02:05,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. after waiting 0 ms 2023-10-05 03:02:05,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7a102b5e2a5889c9f85511bdc3f69bf6: 2023-10-05 03:02:05,643 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:02:05,643 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 867ba937699a9e99f00acb0eb75e7fa0, disabling compactions & flushes 2023-10-05 03:02:05,643 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,643 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,643 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. after waiting 0 ms 2023-10-05 03:02:05,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 867ba937699a9e99f00acb0eb75e7fa0: 2023-10-05 03:02:05,646 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 03:02:05,647 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474925646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474925646"}]},"ts":"1696474925646"} 2023-10-05 03:02:05,647 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474925646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474925646"}]},"ts":"1696474925646"} 2023-10-05 03:02:05,648 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 03:02:05,649 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 03:02:05,649 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474925649"}]},"ts":"1696474925649"} 2023-10-05 03:02:05,650 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-05 03:02:05,654 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 03:02:05,655 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 03:02:05,655 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 03:02:05,655 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 03:02:05,655 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 03:02:05,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, ASSIGN}] 2023-10-05 03:02:05,658 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, ASSIGN 2023-10-05 03:02:05,658 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, ASSIGN 2023-10-05 03:02:05,659 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42403,1696474826248; forceNewPlan=false, retain=false 2023-10-05 03:02:05,659 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39035,1696474826157; forceNewPlan=false, retain=false 2023-10-05 03:02:05,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 03:02:05,809 INFO [jenkins-hbase4:35405] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 03:02:05,812 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7a102b5e2a5889c9f85511bdc3f69bf6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:05,812 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=867ba937699a9e99f00acb0eb75e7fa0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:05,812 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474925812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474925812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474925812"}]},"ts":"1696474925812"} 2023-10-05 03:02:05,812 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474925812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474925812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474925812"}]},"ts":"1696474925812"} 2023-10-05 03:02:05,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 7a102b5e2a5889c9f85511bdc3f69bf6, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:02:05,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 867ba937699a9e99f00acb0eb75e7fa0, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:02:05,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 03:02:05,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a102b5e2a5889c9f85511bdc3f69bf6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 867ba937699a9e99f00acb0eb75e7fa0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. service=AccessControlService 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. service=AccessControlService 2023-10-05 03:02:05,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:02:05,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:02:05,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 03:02:05,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,971 INFO [StoreOpener-867ba937699a9e99f00acb0eb75e7fa0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,971 INFO [StoreOpener-7a102b5e2a5889c9f85511bdc3f69bf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,972 DEBUG [StoreOpener-867ba937699a9e99f00acb0eb75e7fa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf 2023-10-05 03:02:05,972 DEBUG [StoreOpener-7a102b5e2a5889c9f85511bdc3f69bf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf 2023-10-05 03:02:05,972 DEBUG [StoreOpener-7a102b5e2a5889c9f85511bdc3f69bf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf 2023-10-05 03:02:05,972 DEBUG [StoreOpener-867ba937699a9e99f00acb0eb75e7fa0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf 2023-10-05 03:02:05,973 INFO [StoreOpener-7a102b5e2a5889c9f85511bdc3f69bf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a102b5e2a5889c9f85511bdc3f69bf6 columnFamilyName cf 2023-10-05 03:02:05,973 INFO [StoreOpener-867ba937699a9e99f00acb0eb75e7fa0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 867ba937699a9e99f00acb0eb75e7fa0 columnFamilyName cf 2023-10-05 03:02:05,974 INFO [StoreOpener-7a102b5e2a5889c9f85511bdc3f69bf6-1] regionserver.HStore(310): Store=7a102b5e2a5889c9f85511bdc3f69bf6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:02:05,974 INFO [StoreOpener-867ba937699a9e99f00acb0eb75e7fa0-1] regionserver.HStore(310): Store=867ba937699a9e99f00acb0eb75e7fa0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 03:02:05,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:05,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:05,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:02:05,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a102b5e2a5889c9f85511bdc3f69bf6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66649636, jitterRate=-0.0068430304527282715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:02:05,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a102b5e2a5889c9f85511bdc3f69bf6: 2023-10-05 03:02:05,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6., pid=108, masterSystemTime=1696474925965 2023-10-05 03:02:05,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:05,982 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7a102b5e2a5889c9f85511bdc3f69bf6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:05,983 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474925982"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474925982"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474925982"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474925982"}]},"ts":"1696474925982"} 2023-10-05 03:02:05,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 03:02:05,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 867ba937699a9e99f00acb0eb75e7fa0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72596960, jitterRate=0.08177900314331055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 03:02:05,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 867ba937699a9e99f00acb0eb75e7fa0: 2023-10-05 03:02:05,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0., pid=109, masterSystemTime=1696474925966 2023-10-05 03:02:05,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:05,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=867ba937699a9e99f00acb0eb75e7fa0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:05,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474925985"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696474925985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696474925985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696474925985"}]},"ts":"1696474925985"} 2023-10-05 03:02:05,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-10-05 03:02:05,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 7a102b5e2a5889c9f85511bdc3f69bf6, server=jenkins-hbase4.apache.org,39035,1696474826157 in 170 msec 2023-10-05 03:02:05,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, ASSIGN in 330 msec 2023-10-05 03:02:05,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-05 03:02:05,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 867ba937699a9e99f00acb0eb75e7fa0, server=jenkins-hbase4.apache.org,42403,1696474826248 in 173 msec 2023-10-05 03:02:05,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-05 03:02:05,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, ASSIGN in 332 msec 2023-10-05 03:02:05,990 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 03:02:05,990 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474925990"}]},"ts":"1696474925990"} 2023-10-05 03:02:05,991 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-05 03:02:05,994 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 03:02:05,994 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-05 03:02:05,996 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 03:02:05,997 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,998 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,998 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,997 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:05,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 03:02:05,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 03:02:05,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 03:02:06,000 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 03:02:06,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 399 msec 2023-10-05 03:02:06,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 03:02:06,207 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-05 03:02:06,209 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,210 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:06,211 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:02:06,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 03:02:06,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474926222 (current time:1696474926222). 2023-10-05 03:02:06,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:02:06,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x6cfe5089 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:02:06,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5361dc5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:02:06,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:02:06,233 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:02:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cfe5089 to 127.0.0.1:56535 2023-10-05 03:02:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:06,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x488ad633 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:02:06,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56eebdb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:02:06,240 DEBUG [hconnection-0xb303031-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:02:06,242 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:02:06,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x488ad633 to 127.0.0.1:56535 2023-10-05 03:02:06,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:06,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 03:02:06,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:02:06,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 03:02:06,249 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:02:06,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 03:02:06,251 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 03:02:06,252 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696475526252 2023-10-05 03:02:06,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 03:02:06,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,253 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:02:06,253 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:02:06,254 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 03:02:06,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 03:02:06,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 03:02:06,256 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 03:02:06,257 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696475526257 2023-10-05 03:02:06,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,267 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 03:02:06,267 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,269 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 03:02:06,269 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 03:02:06,269 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,269 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,271 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,271 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,271 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,271 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,271 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,272 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,272 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,272 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 03:02:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 03:02:06,273 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 03:02:06,273 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,273 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 03:02:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 03:02:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 03:02:06,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 03:02:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 03:02:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,274 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,275 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 03:02:06,276 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 03:02:06,276 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 03:02:06,276 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 03:02:06,276 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 03:02:06,276 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 03:02:06,283 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,283 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,284 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:02:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,284 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:02:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@680ed52d[Count = 1] remaining members to acquire global barrier 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 03:02:06,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@680ed52d[Count = 0] remaining members to acquire global barrier 2023-10-05 03:02:06,287 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 03:02:06,288 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 03:02:06,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 03:02:06,289 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 03:02:06,289 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:06,289 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. started... 2023-10-05 03:02:06,289 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,290 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:02:06,290 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:06,289 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:02:06,290 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:02:06,290 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a102b5e2a5889c9f85511bdc3f69bf6: 2023-10-05 03:02:06,290 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. started... 2023-10-05 03:02:06,290 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,291 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 867ba937699a9e99f00acb0eb75e7fa0: 2023-10-05 03:02:06,291 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:02:06,291 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:02:06,291 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 03:02:06,291 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,291 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,291 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 03:02:06,292 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:02:06,292 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 03:02:06,299 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. completed. 2023-10-05 03:02:06,299 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,299 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. completed. 2023-10-05 03:02:06,299 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 03:02:06,299 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:02:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 03:02:06,302 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 03:02:06,303 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,302 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,303 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 03:02:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,303 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,304 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,304 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 03:02:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:02:06,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 03:02:06,311 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 03:02:06,311 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:02:06,311 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:02:06,311 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,311 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,313 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,314 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,314 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,316 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,316 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,316 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,319 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,319 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:02:06,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,321 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 03:02:06,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 03:02:06,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,346 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696474926252Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696474926330 (+78 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696474926330Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696474926330Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696474926333 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696474926341 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696474926346 (+5 ms) 2023-10-05 03:02:06,349 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 03:02:06,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 96 msec 2023-10-05 03:02:06,353 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:02:06,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 03:02:06,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:02:06,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39035] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:02:06,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42403] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 03:02:06,359 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,359 DEBUG [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:06,359 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 03:02:06,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 03:02:06,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696474926368 (current time:1696474926368). 2023-10-05 03:02:06,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 03:02:06,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x1de6246d to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:02:06,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5143d5ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:02:06,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:02:06,380 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:02:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1de6246d to 127.0.0.1:56535 2023-10-05 03:02:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(139): Connect 0x03880d22 to 127.0.0.1:56535 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 03:02:06,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f618472, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 03:02:06,388 DEBUG [hconnection-0x60c2c8d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 03:02:06,389 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 03:02:06,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03880d22 to 127.0.0.1:56535 2023-10-05 03:02:06,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:06,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 03:02:06,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 03:02:06,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 03:02:06,396 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot, current working dir path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 03:02:06,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 03:02:06,398 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 03:02:06,399 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696475526399 2023-10-05 03:02:06,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 03:02:06,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,400 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 03:02:06,400 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 03:02:06,401 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 03:02:06,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 03:02:06,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 03:02:06,403 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 03:02:06,403 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696475526403 2023-10-05 03:02:06,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,417 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 03:02:06,417 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,419 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 03:02:06,419 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 03:02:06,419 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,419 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,421 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,421 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,421 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,421 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,421 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,421 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,422 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 03:02:06,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 03:02:06,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,423 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 03:02:06,423 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 03:02:06,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 03:02:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 03:02:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 03:02:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 03:02:06,428 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 03:02:06,429 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 03:02:06,429 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 03:02:06,430 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 03:02:06,430 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 03:02:06,430 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 03:02:06,430 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 03:02:06,430 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33679,1696474826205' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 03:02:06,433 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,433 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,433 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:02:06,433 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:02:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,434 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 03:02:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39035,1696474826157' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b27cb3[Count = 1] remaining members to acquire global barrier 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42403,1696474826248' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 03:02:06,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78b27cb3[Count = 0] remaining members to acquire global barrier 2023-10-05 03:02:06,438 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 03:02:06,438 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 03:02:06,442 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 03:02:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 03:02:06,442 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,442 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 03:02:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:02:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:02:06,442 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 03:02:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 03:02:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 03:02:06,442 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:06,443 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:06,443 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. started... 2023-10-05 03:02:06,443 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33679,1696474826205' in zk 2023-10-05 03:02:06,443 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. started... 2023-10-05 03:02:06,443 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7a102b5e2a5889c9f85511bdc3f69bf6 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-05 03:02:06,443 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 867ba937699a9e99f00acb0eb75e7fa0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-05 03:02:06,446 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 03:02:06,446 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,446 DEBUG [member: 'jenkins-hbase4.apache.org,33679,1696474826205' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 03:02:06,460 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005a98f6726db174463a1daee1b1ba1e520 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005a98f6726db174463a1daee1b1ba1e520 2023-10-05 03:02:06,473 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100539f23e5c58b549bab2aff68e023c736c to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100539f23e5c58b549bab2aff68e023c736c 2023-10-05 03:02:06,476 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/.tmp/cf/bfb7725315dc498d9f05d303085f233c 2023-10-05 03:02:06,480 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/.tmp/cf/9d951d7364dc415f920e089cc1112fb0 2023-10-05 03:02:06,481 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/.tmp/cf/bfb7725315dc498d9f05d303085f233c as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf/bfb7725315dc498d9f05d303085f233c 2023-10-05 03:02:06,484 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/.tmp/cf/9d951d7364dc415f920e089cc1112fb0 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf/9d951d7364dc415f920e089cc1112fb0 2023-10-05 03:02:06,485 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf/bfb7725315dc498d9f05d303085f233c, entries=2, sequenceid=6, filesize=5.2 K 2023-10-05 03:02:06,486 INFO [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 7a102b5e2a5889c9f85511bdc3f69bf6 in 43ms, sequenceid=6, compaction requested=false 2023-10-05 03:02:06,486 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 03:02:06,486 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a102b5e2a5889c9f85511bdc3f69bf6: 2023-10-05 03:02:06,486 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,487 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:02:06,487 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf/bfb7725315dc498d9f05d303085f233c] hfiles 2023-10-05 03:02:06,487 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf/bfb7725315dc498d9f05d303085f233c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,488 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf/9d951d7364dc415f920e089cc1112fb0, entries=48, sequenceid=6, filesize=13.5 K 2023-10-05 03:02:06,489 INFO [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 867ba937699a9e99f00acb0eb75e7fa0 in 46ms, sequenceid=6, compaction requested=false 2023-10-05 03:02:06,490 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 867ba937699a9e99f00acb0eb75e7fa0: 2023-10-05 03:02:06,491 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,491 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 03:02:06,491 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf/9d951d7364dc415f920e089cc1112fb0] hfiles 2023-10-05 03:02:06,491 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf/9d951d7364dc415f920e089cc1112fb0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. completed. 2023-10-05 03:02:06,494 DEBUG [rs(jenkins-hbase4.apache.org,39035,1696474826157)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:06,494 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:02:06,494 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:02:06,494 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,494 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 03:02:06,494 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39035,1696474826157' in zk 2023-10-05 03:02:06,497 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 03:02:06,497 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,497 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,497 DEBUG [member: 'jenkins-hbase4.apache.org,39035,1696474826157' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 03:02:06,499 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. completed. 2023-10-05 03:02:06,499 DEBUG [rs(jenkins-hbase4.apache.org,42403,1696474826248)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,499 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 03:02:06,499 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 03:02:06,499 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,499 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 03:02:06,499 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42403,1696474826248' in zk 2023-10-05 03:02:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,500 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 03:02:06,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,500 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:02:06,500 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,501 DEBUG [member: 'jenkins-hbase4.apache.org,42403,1696474826248' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 03:02:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 03:02:06,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 03:02:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,503 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 03:02:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39035,1696474826157': 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39035,1696474826157' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42403,1696474826248': 2023-10-05 03:02:06,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42403,1696474826248' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 03:02:06,507 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 03:02:06,507 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 03:02:06,507 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 03:02:06,507 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,507 INFO [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 03:02:06,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,509 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 03:02:06,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,510 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,510 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 03:02:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 03:02:06,512 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,512 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,512 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,519 DEBUG [(jenkins-hbase4.apache.org,35405,1696474824903)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 03:02:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,519 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,521 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 03:02:06,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 03:02:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 03:02:06,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,521 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 03:02:06,521 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,522 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:06,522 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,522 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:06,522 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:06,522 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,522 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 03:02:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 03:02:06,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100539f23e5c58b549bab2aff68e023c736c, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005a98f6726db174463a1daee1b1ba1e520] mob files 2023-10-05 03:02:06,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100539f23e5c58b549bab2aff68e023c736c 2023-10-05 03:02:06,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005a98f6726db174463a1daee1b1ba1e520 2023-10-05 03:02:06,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 03:02:06,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696474926399Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696474926528 (+129 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696474926528Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696474926528Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696474926531 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696474926543 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696474926549 (+6 ms) 2023-10-05 03:02:06,552 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 03:02:06,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 152 msec 2023-10-05 03:02:06,703 DEBUG [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 03:02:06,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 03:02:06,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 03:02:06,704 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704 2023-10-05 03:02:06,704 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34213, tgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704, rawTgtDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704, srcFsUri=hdfs://localhost:34213, srcDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:02:06,726 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f 2023-10-05 03:02:06,726 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_776020579_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,726 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34213, inputRoot=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f, snapshotDir=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-05 03:02:06,734 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:06,766 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:06,767 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:06,767 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:06,767 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,639 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-1486958021041537153.jar 2023-10-05 03:02:07,640 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,640 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,706 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/hadoop-61275068855318072.jar 2023-10-05 03:02:07,707 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,707 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,708 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 03:02:07,709 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 03:02:07,709 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 03:02:07,710 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 03:02:07,710 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 03:02:07,710 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 03:02:07,711 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 03:02:07,711 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 03:02:07,711 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 03:02:07,712 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 03:02:07,712 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 03:02:07,713 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:02:07,713 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:02:07,714 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:02:07,714 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:02:07,714 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 03:02:07,714 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:02:07,715 DEBUG [Listener at jenkins-hbase4.apache.org/40081] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 03:02:08,052 WARN [Listener at jenkins-hbase4.apache.org/40081] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 03:02:08,054 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-05 03:02:08,056 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-05 03:02:10,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:02:10,028 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 03:02:10,031 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0006_000001 (auth:SIMPLE) 2023-10-05 03:02:10,459 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0007_000001 (auth:SIMPLE) 2023-10-05 03:02:10,871 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:02:14,262 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0007_000001 (auth:SIMPLE) 2023-10-05 03:02:16,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0007_000001 (auth:SIMPLE) 2023-10-05 03:02:19,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0007_000001 (auth:SIMPLE) 2023-10-05 03:02:20,209 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 03:02:20,209 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 03:02:20,220 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,220 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 03:02:20,220 INFO [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 03:02:20,220 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 03:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 03:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1646300037_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 03:02:20,221 DEBUG [Listener at jenkins-hbase4.apache.org/40081] snapshot.TestExportSnapshot(367): hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/export-test/export-1696474926704/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 03:02:20,227 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 03:02:20,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474940230"}]},"ts":"1696474940230"} 2023-10-05 03:02:20,232 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-05 03:02:20,233 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-05 03:02:20,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, UNASSIGN}] 2023-10-05 03:02:20,235 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, UNASSIGN 2023-10-05 03:02:20,235 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, UNASSIGN 2023-10-05 03:02:20,236 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7a102b5e2a5889c9f85511bdc3f69bf6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:20,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=867ba937699a9e99f00acb0eb75e7fa0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:20,236 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474940236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474940236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474940236"}]},"ts":"1696474940236"} 2023-10-05 03:02:20,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474940236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696474940236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696474940236"}]},"ts":"1696474940236"} 2023-10-05 03:02:20,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 7a102b5e2a5889c9f85511bdc3f69bf6, server=jenkins-hbase4.apache.org,39035,1696474826157}] 2023-10-05 03:02:20,238 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 867ba937699a9e99f00acb0eb75e7fa0, server=jenkins-hbase4.apache.org,42403,1696474826248}] 2023-10-05 03:02:20,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 03:02:20,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:20,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a102b5e2a5889c9f85511bdc3f69bf6, disabling compactions & flushes 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 867ba937699a9e99f00acb0eb75e7fa0, disabling compactions & flushes 2023-10-05 03:02:20,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:20,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. after waiting 0 ms 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:20,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. after waiting 0 ms 2023-10-05 03:02:20,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:20,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:02:20,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:02:20,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:20,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:20,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6. 2023-10-05 03:02:20,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0. 2023-10-05 03:02:20,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 867ba937699a9e99f00acb0eb75e7fa0: 2023-10-05 03:02:20,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a102b5e2a5889c9f85511bdc3f69bf6: 2023-10-05 03:02:20,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:20,405 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=867ba937699a9e99f00acb0eb75e7fa0, regionState=CLOSED 2023-10-05 03:02:20,405 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474940405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474940405"}]},"ts":"1696474940405"} 2023-10-05 03:02:20,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:20,408 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7a102b5e2a5889c9f85511bdc3f69bf6, regionState=CLOSED 2023-10-05 03:02:20,408 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696474940408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696474940408"}]},"ts":"1696474940408"} 2023-10-05 03:02:20,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-05 03:02:20,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 867ba937699a9e99f00acb0eb75e7fa0, server=jenkins-hbase4.apache.org,42403,1696474826248 in 170 msec 2023-10-05 03:02:20,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=867ba937699a9e99f00acb0eb75e7fa0, UNASSIGN in 175 msec 2023-10-05 03:02:20,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-05 03:02:20,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 7a102b5e2a5889c9f85511bdc3f69bf6, server=jenkins-hbase4.apache.org,39035,1696474826157 in 172 msec 2023-10-05 03:02:20,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-05 03:02:20,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7a102b5e2a5889c9f85511bdc3f69bf6, UNASSIGN in 177 msec 2023-10-05 03:02:20,413 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696474940413"}]},"ts":"1696474940413"} 2023-10-05 03:02:20,414 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-05 03:02:20,415 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-05 03:02:20,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-10-05 03:02:20,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 03:02:20,532 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-05 03:02:20,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,536 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,536 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,538 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39035] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,541 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:20,541 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,541 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,541 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,541 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,541 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:20,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 03:02:20,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 03:02:20,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 03:02:20,543 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,543 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:20,543 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:20,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-10-05 03:02:20,543 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 03:02:20,543 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,543 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/recovered.edits] 2023-10-05 03:02:20,543 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:20,544 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,544 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf, FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/recovered.edits] 2023-10-05 03:02:20,544 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 03:02:20,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 03:02:20,548 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf/bfb7725315dc498d9f05d303085f233c to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/cf/bfb7725315dc498d9f05d303085f233c 2023-10-05 03:02:20,549 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf/9d951d7364dc415f920e089cc1112fb0 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/cf/9d951d7364dc415f920e089cc1112fb0 2023-10-05 03:02:20,552 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6/recovered.edits/9.seqid 2023-10-05 03:02:20,552 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/recovered.edits/9.seqid to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0/recovered.edits/9.seqid 2023-10-05 03:02:20,552 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7a102b5e2a5889c9f85511bdc3f69bf6 2023-10-05 03:02:20,552 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/867ba937699a9e99f00acb0eb75e7fa0 2023-10-05 03:02:20,553 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 03:02:20,553 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 03:02:20,554 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-05 03:02:20,558 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100539f23e5c58b549bab2aff68e023c736c to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100539f23e5c58b549bab2aff68e023c736c 2023-10-05 03:02:20,559 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005a98f6726db174463a1daee1b1ba1e520 to hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231005a98f6726db174463a1daee1b1ba1e520 2023-10-05 03:02:20,559 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 03:02:20,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,564 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-05 03:02:20,565 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-05 03:02:20,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,567 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-05 03:02:20,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474940567"}]},"ts":"9223372036854775807"} 2023-10-05 03:02:20,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696474940567"}]},"ts":"9223372036854775807"} 2023-10-05 03:02:20,568 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 03:02:20,568 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7a102b5e2a5889c9f85511bdc3f69bf6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696474925600.7a102b5e2a5889c9f85511bdc3f69bf6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 867ba937699a9e99f00acb0eb75e7fa0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696474925600.867ba937699a9e99f00acb0eb75e7fa0.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 03:02:20,568 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-05 03:02:20,569 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696474940568"}]},"ts":"9223372036854775807"} 2023-10-05 03:02:20,570 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-05 03:02:20,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 39 msec 2023-10-05 03:02:20,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 03:02:20,645 INFO [Listener at jenkins-hbase4.apache.org/40081] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-05 03:02:20,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 03:02:20,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 03:02:20,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35405] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 03:02:20,683 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=909 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=153 (was 119) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5664 (was 5736) 2023-10-05 03:02:20,683 WARN [Listener at jenkins-hbase4.apache.org/40081] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 03:02:20,683 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-05 03:02:20,698 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 03:02:25,224 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696474832679_0007_000001 (auth:SIMPLE) 2023-10-05 03:02:25,973 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 03:02:34,826 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 03:02:48,947 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 03:02:48,948 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 03:02:49,059 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-05 03:02:49,067 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-05 03:02:49,068 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 03:02:49,078 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 03:02:49,182 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 03:02:49,182 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-05 03:02:49,182 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-05 03:02:49,182 INFO [Listener at jenkins-hbase4.apache.org/40081] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-05 03:02:49,182 DEBUG [Listener at jenkins-hbase4.apache.org/40081] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4170740d to 127.0.0.1:56535 2023-10-05 03:02:49,182 DEBUG [Listener at jenkins-hbase4.apache.org/40081] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,182 DEBUG [Listener at jenkins-hbase4.apache.org/40081] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-05 03:02:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/40081] util.JVMClusterUtil(257): Found active master hash=449485541, stopped=false 2023-10-05 03:02:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/40081] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,183 DEBUG [Listener at jenkins-hbase4.apache.org/40081] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 03:02:49,183 INFO [Listener at jenkins-hbase4.apache.org/40081] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:02:49,184 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 03:02:49,184 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 03:02:49,184 INFO [Listener at jenkins-hbase4.apache.org/40081] procedure2.ProcedureExecutor(628): Stopping 2023-10-05 03:02:49,184 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 03:02:49,184 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 03:02:49,184 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 03:02:49,185 DEBUG [Listener at jenkins-hbase4.apache.org/40081] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40e13c8f to 127.0.0.1:56535 2023-10-05 03:02:49,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:02:49,185 DEBUG [Listener at jenkins-hbase4.apache.org/40081] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:02:49,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:02:49,185 INFO [Listener at jenkins-hbase4.apache.org/40081] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39035,1696474826157' ***** 2023-10-05 03:02:49,185 DEBUG [Listener at jenkins-hbase4.apache.org/40081] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,185 INFO [Listener at jenkins-hbase4.apache.org/40081] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 03:02:49,185 INFO [Listener at jenkins-hbase4.apache.org/40081] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33679,1696474826205' ***** 2023-10-05 03:02:49,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 03:02:49,185 DEBUG [Listener at jenkins-hbase4.apache.org/40081] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,186 INFO [Listener at jenkins-hbase4.apache.org/40081] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 03:02:49,185 INFO [RS:0;jenkins-hbase4:39035] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 03:02:49,186 INFO [Listener at jenkins-hbase4.apache.org/40081] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42403,1696474826248' ***** 2023-10-05 03:02:49,186 INFO [RS:1;jenkins-hbase4:33679] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 03:02:49,186 INFO [RS:0;jenkins-hbase4:39035] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 03:02:49,186 INFO [RS:1;jenkins-hbase4:33679] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 03:02:49,186 INFO [RS:0;jenkins-hbase4:39035] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 03:02:49,186 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 03:02:49,186 DEBUG [Listener at jenkins-hbase4.apache.org/40081] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,186 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 03:02:49,186 INFO [RS:1;jenkins-hbase4:33679] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 03:02:49,186 INFO [Listener at jenkins-hbase4.apache.org/40081] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 03:02:49,186 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(3305): Received CLOSE for 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:02:49,186 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(3305): Received CLOSE for dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:02:49,186 INFO [RS:2;jenkins-hbase4:42403] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 03:02:49,187 INFO [RS:2;jenkins-hbase4:42403] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 03:02:49,187 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 03:02:49,187 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:49,187 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:49,187 DEBUG [RS:0;jenkins-hbase4:39035] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17398b43 to 127.0.0.1:56535 2023-10-05 03:02:49,187 INFO [RS:2;jenkins-hbase4:42403] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 03:02:49,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc299273bf6d63c8a0cebc83d19f4f38, disabling compactions & flushes 2023-10-05 03:02:49,188 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:49,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:02:49,189 DEBUG [RS:2;jenkins-hbase4:42403] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x294828c6 to 127.0.0.1:56535 2023-10-05 03:02:49,187 DEBUG [RS:0;jenkins-hbase4:39035] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,189 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,190 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 03:02:49,192 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42403,1696474826248; all regions closed. 2023-10-05 03:02:49,187 DEBUG [RS:1;jenkins-hbase4:33679] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42c21170 to 127.0.0.1:56535 2023-10-05 03:02:49,191 INFO [RS:0;jenkins-hbase4:39035] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 03:02:49,192 INFO [RS:0;jenkins-hbase4:39035] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 03:02:49,192 INFO [RS:0;jenkins-hbase4:39035] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 03:02:49,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:02:49,192 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-05 03:02:49,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b2123a2b59a6c50d9bb9bb249a71276, disabling compactions & flushes 2023-10-05 03:02:49,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. after waiting 0 ms 2023-10-05 03:02:49,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:02:49,192 DEBUG [RS:1;jenkins-hbase4:33679] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:02:49,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing dc299273bf6d63c8a0cebc83d19f4f38 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-05 03:02:49,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:02:49,193 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-10-05 03:02:49,193 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 03:02:49,193 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, dc299273bf6d63c8a0cebc83d19f4f38=hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38.} 2023-10-05 03:02:49,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. after waiting 0 ms 2023-10-05 03:02:49,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 03:02:49,193 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1478): Online Regions={4b2123a2b59a6c50d9bb9bb249a71276=hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276.} 2023-10-05 03:02:49,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 03:02:49,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:02:49,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 03:02:49,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4b2123a2b59a6c50d9bb9bb249a71276 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-05 03:02:49,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 03:02:49,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 03:02:49,194 DEBUG [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1504): Waiting on 1588230740, dc299273bf6d63c8a0cebc83d19f4f38 2023-10-05 03:02:49,195 DEBUG [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1504): Waiting on 4b2123a2b59a6c50d9bb9bb249a71276 2023-10-05 03:02:49,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-05 03:02:49,211 DEBUG [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs 2023-10-05 03:02:49,211 INFO [RS:2;jenkins-hbase4:42403] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42403%2C1696474826248:(num 1696474827903) 2023-10-05 03:02:49,211 DEBUG [RS:2;jenkins-hbase4:42403] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,211 INFO [RS:2;jenkins-hbase4:42403] regionserver.LeaseManager(133): Closed leases 2023-10-05 03:02:49,215 INFO [RS:2;jenkins-hbase4:42403] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 03:02:49,215 INFO [RS:2;jenkins-hbase4:42403] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 03:02:49,215 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 03:02:49,215 INFO [RS:2;jenkins-hbase4:42403] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 03:02:49,216 INFO [RS:2;jenkins-hbase4:42403] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 03:02:49,219 INFO [RS:2;jenkins-hbase4:42403] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42403 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42403,1696474826248 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:02:49,227 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:02:49,228 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42403,1696474826248] 2023-10-05 03:02:49,228 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42403,1696474826248; numProcessing=1 2023-10-05 03:02:49,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/.tmp/info/981989a8445c4b1ab23e77145130de8b 2023-10-05 03:02:49,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/.tmp/l/7be3c9712df74ec0be6a8d392d1b199d 2023-10-05 03:02:49,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/.tmp/info/734328a42eb44d5fb79d737b42c87479 2023-10-05 03:02:49,231 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42403,1696474826248 already deleted, retry=false 2023-10-05 03:02:49,231 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42403,1696474826248 expired; onlineServers=2 2023-10-05 03:02:49,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 734328a42eb44d5fb79d737b42c87479 2023-10-05 03:02:49,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/.tmp/info/981989a8445c4b1ab23e77145130de8b as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/info/981989a8445c4b1ab23e77145130de8b 2023-10-05 03:02:49,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7be3c9712df74ec0be6a8d392d1b199d 2023-10-05 03:02:49,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/.tmp/l/7be3c9712df74ec0be6a8d392d1b199d as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/l/7be3c9712df74ec0be6a8d392d1b199d 2023-10-05 03:02:49,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/info/981989a8445c4b1ab23e77145130de8b, entries=2, sequenceid=6, filesize=4.8 K 2023-10-05 03:02:49,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4b2123a2b59a6c50d9bb9bb249a71276 in 58ms, sequenceid=6, compaction requested=false 2023-10-05 03:02:49,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7be3c9712df74ec0be6a8d392d1b199d 2023-10-05 03:02:49,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/l/7be3c9712df74ec0be6a8d392d1b199d, entries=7, sequenceid=18, filesize=5.2 K 2023-10-05 03:02:49,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for dc299273bf6d63c8a0cebc83d19f4f38 in 69ms, sequenceid=18, compaction requested=false 2023-10-05 03:02:49,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/.tmp/rep_barrier/e662aa28f10746ed98ad6c315c96f73d 2023-10-05 03:02:49,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/namespace/4b2123a2b59a6c50d9bb9bb249a71276/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 03:02:49,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:02:49,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b2123a2b59a6c50d9bb9bb249a71276: 2023-10-05 03:02:49,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696474828356.4b2123a2b59a6c50d9bb9bb249a71276. 2023-10-05 03:02:49,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/acl/dc299273bf6d63c8a0cebc83d19f4f38/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-05 03:02:49,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e662aa28f10746ed98ad6c315c96f73d 2023-10-05 03:02:49,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:02:49,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc299273bf6d63c8a0cebc83d19f4f38: 2023-10-05 03:02:49,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696474829102.dc299273bf6d63c8a0cebc83d19f4f38. 2023-10-05 03:02:49,272 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 03:02:49,272 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 03:02:49,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/.tmp/table/31f34000044b413093b8233d8c16c003 2023-10-05 03:02:49,283 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31f34000044b413093b8233d8c16c003 2023-10-05 03:02:49,284 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/.tmp/info/734328a42eb44d5fb79d737b42c87479 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/info/734328a42eb44d5fb79d737b42c87479 2023-10-05 03:02:49,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 734328a42eb44d5fb79d737b42c87479 2023-10-05 03:02:49,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/info/734328a42eb44d5fb79d737b42c87479, entries=48, sequenceid=131, filesize=10.3 K 2023-10-05 03:02:49,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/.tmp/rep_barrier/e662aa28f10746ed98ad6c315c96f73d as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/rep_barrier/e662aa28f10746ed98ad6c315c96f73d 2023-10-05 03:02:49,293 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e662aa28f10746ed98ad6c315c96f73d 2023-10-05 03:02:49,293 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/rep_barrier/e662aa28f10746ed98ad6c315c96f73d, entries=13, sequenceid=131, filesize=6.4 K 2023-10-05 03:02:49,294 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/.tmp/table/31f34000044b413093b8233d8c16c003 as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/table/31f34000044b413093b8233d8c16c003 2023-10-05 03:02:49,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31f34000044b413093b8233d8c16c003 2023-10-05 03:02:49,298 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/table/31f34000044b413093b8233d8c16c003, entries=24, sequenceid=131, filesize=6.9 K 2023-10-05 03:02:49,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 104ms, sequenceid=131, compaction requested=false 2023-10-05 03:02:49,310 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-05 03:02:49,310 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 03:02:49,310 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 03:02:49,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 03:02:49,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 03:02:49,311 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-05 03:02:49,331 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,331 INFO [RS:2;jenkins-hbase4:42403] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42403,1696474826248; zookeeper connection closed. 2023-10-05 03:02:49,331 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:42403-0x1011486b4b10003, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,332 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@34a12cdd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@34a12cdd 2023-10-05 03:02:49,395 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39035,1696474826157; all regions closed. 2023-10-05 03:02:49,395 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33679,1696474826205; all regions closed. 2023-10-05 03:02:49,402 DEBUG [RS:1;jenkins-hbase4:33679] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs 2023-10-05 03:02:49,402 INFO [RS:1;jenkins-hbase4:33679] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33679%2C1696474826205:(num 1696474827903) 2023-10-05 03:02:49,402 DEBUG [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs 2023-10-05 03:02:49,402 DEBUG [RS:1;jenkins-hbase4:33679] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,402 INFO [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39035%2C1696474826157.meta:.meta(num 1696474828055) 2023-10-05 03:02:49,402 INFO [RS:1;jenkins-hbase4:33679] regionserver.LeaseManager(133): Closed leases 2023-10-05 03:02:49,402 INFO [RS:1;jenkins-hbase4:33679] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 03:02:49,403 INFO [RS:1;jenkins-hbase4:33679] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 03:02:49,403 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 03:02:49,403 INFO [RS:1;jenkins-hbase4:33679] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 03:02:49,403 INFO [RS:1;jenkins-hbase4:33679] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 03:02:49,404 INFO [RS:1;jenkins-hbase4:33679] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33679 2023-10-05 03:02:49,406 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:49,406 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:02:49,406 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33679,1696474826205 2023-10-05 03:02:49,408 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33679,1696474826205] 2023-10-05 03:02:49,408 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33679,1696474826205; numProcessing=2 2023-10-05 03:02:49,409 DEBUG [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/oldWALs 2023-10-05 03:02:49,409 INFO [RS:0;jenkins-hbase4:39035] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39035%2C1696474826157:(num 1696474827902) 2023-10-05 03:02:49,409 DEBUG [RS:0;jenkins-hbase4:39035] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,410 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33679,1696474826205 already deleted, retry=false 2023-10-05 03:02:49,410 INFO [RS:0;jenkins-hbase4:39035] regionserver.LeaseManager(133): Closed leases 2023-10-05 03:02:49,410 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33679,1696474826205 expired; onlineServers=1 2023-10-05 03:02:49,410 INFO [RS:0;jenkins-hbase4:39035] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 03:02:49,410 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 03:02:49,411 INFO [RS:0;jenkins-hbase4:39035] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39035 2023-10-05 03:02:49,413 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39035,1696474826157 2023-10-05 03:02:49,413 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 03:02:49,414 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39035,1696474826157] 2023-10-05 03:02:49,414 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39035,1696474826157; numProcessing=3 2023-10-05 03:02:49,415 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39035,1696474826157 already deleted, retry=false 2023-10-05 03:02:49,415 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39035,1696474826157 expired; onlineServers=0 2023-10-05 03:02:49,415 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35405,1696474824903' ***** 2023-10-05 03:02:49,415 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-05 03:02:49,415 DEBUG [M:0;jenkins-hbase4:35405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bf790de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 03:02:49,415 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35405,1696474824903 2023-10-05 03:02:49,415 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35405,1696474824903; all regions closed. 2023-10-05 03:02:49,415 DEBUG [M:0;jenkins-hbase4:35405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 03:02:49,416 DEBUG [M:0;jenkins-hbase4:35405] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-05 03:02:49,416 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-05 03:02:49,416 DEBUG [M:0;jenkins-hbase4:35405] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-05 03:02:49,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696474827536] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696474827536,5,FailOnTimeoutGroup] 2023-10-05 03:02:49,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696474827535] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696474827535,5,FailOnTimeoutGroup] 2023-10-05 03:02:49,416 INFO [M:0;jenkins-hbase4:35405] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-05 03:02:49,416 INFO [M:0;jenkins-hbase4:35405] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-05 03:02:49,416 INFO [M:0;jenkins-hbase4:35405] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-05 03:02:49,416 DEBUG [M:0;jenkins-hbase4:35405] master.HMaster(1512): Stopping service threads 2023-10-05 03:02:49,416 INFO [M:0;jenkins-hbase4:35405] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-05 03:02:49,416 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-05 03:02:49,417 ERROR [M:0;jenkins-hbase4:35405] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-10-05 03:02:49,417 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-05 03:02:49,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 03:02:49,417 INFO [M:0;jenkins-hbase4:35405] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-05 03:02:49,417 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-05 03:02:49,418 DEBUG [M:0;jenkins-hbase4:35405] zookeeper.ZKUtil(398): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-05 03:02:49,418 WARN [M:0;jenkins-hbase4:35405] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-05 03:02:49,418 INFO [M:0;jenkins-hbase4:35405] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-05 03:02:49,418 INFO [M:0;jenkins-hbase4:35405] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-05 03:02:49,418 DEBUG [M:0;jenkins-hbase4:35405] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 03:02:49,418 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:02:49,418 DEBUG [M:0;jenkins-hbase4:35405] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:02:49,418 DEBUG [M:0;jenkins-hbase4:35405] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 03:02:49,418 DEBUG [M:0;jenkins-hbase4:35405] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:02:49,419 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.88 KB heapSize=452.15 KB 2023-10-05 03:02:49,430 INFO [M:0;jenkins-hbase4:35405] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.88 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d1fd8699d6434e73a58f484486d26b2e 2023-10-05 03:02:49,434 INFO [M:0;jenkins-hbase4:35405] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1fd8699d6434e73a58f484486d26b2e 2023-10-05 03:02:49,435 DEBUG [M:0;jenkins-hbase4:35405] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d1fd8699d6434e73a58f484486d26b2e as hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d1fd8699d6434e73a58f484486d26b2e 2023-10-05 03:02:49,438 INFO [M:0;jenkins-hbase4:35405] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1fd8699d6434e73a58f484486d26b2e 2023-10-05 03:02:49,438 INFO [M:0;jenkins-hbase4:35405] regionserver.HStore(1080): Added hdfs://localhost:34213/user/jenkins/test-data/b3475b7e-c199-5e13-364e-24c6fabdf72f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d1fd8699d6434e73a58f484486d26b2e, entries=119, sequenceid=899, filesize=28.7 K 2023-10-05 03:02:49,439 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegion(2948): Finished flush of dataSize ~375.88 KB/384903, heapSize ~452.13 KB/462984, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-05 03:02:49,441 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 03:02:49,441 DEBUG [M:0;jenkins-hbase4:35405] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 03:02:49,444 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 03:02:49,444 INFO [M:0;jenkins-hbase4:35405] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-05 03:02:49,445 INFO [M:0;jenkins-hbase4:35405] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35405 2023-10-05 03:02:49,447 DEBUG [M:0;jenkins-hbase4:35405] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35405,1696474824903 already deleted, retry=false 2023-10-05 03:02:49,508 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,509 INFO [RS:1;jenkins-hbase4:33679] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33679,1696474826205; zookeeper connection closed. 2023-10-05 03:02:49,509 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:33679-0x1011486b4b10002, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,509 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10f923c6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10f923c6 2023-10-05 03:02:49,609 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,609 INFO [M:0;jenkins-hbase4:35405] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35405,1696474824903; zookeeper connection closed. 2023-10-05 03:02:49,609 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): master:35405-0x1011486b4b10000, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,709 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,709 INFO [RS:0;jenkins-hbase4:39035] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39035,1696474826157; zookeeper connection closed. 2023-10-05 03:02:49,709 DEBUG [Listener at localhost/41459-EventThread] zookeeper.ZKWatcher(600): regionserver:39035-0x1011486b4b10001, quorum=127.0.0.1:56535, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 03:02:49,709 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42338ecc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42338ecc 2023-10-05 03:02:49,710 INFO [Listener at jenkins-hbase4.apache.org/40081] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-05 03:02:49,710 WARN [Listener at jenkins-hbase4.apache.org/40081] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 03:02:49,714 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 03:02:49,817 WARN [BP-891872882-172.31.14.131-1696474821124 heartbeating to localhost/127.0.0.1:34213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 03:02:49,817 WARN [BP-891872882-172.31.14.131-1696474821124 heartbeating to localhost/127.0.0.1:34213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891872882-172.31.14.131-1696474821124 (Datanode Uuid 617c9964-e384-4c17-ae3f-42a0981fc6b3) service to localhost/127.0.0.1:34213 2023-10-05 03:02:49,819 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data5/current/BP-891872882-172.31.14.131-1696474821124] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 03:02:49,819 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data6/current/BP-891872882-172.31.14.131-1696474821124] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 03:02:49,821 WARN [Listener at jenkins-hbase4.apache.org/40081] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 03:02:49,822 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 03:02:49,926 WARN [BP-891872882-172.31.14.131-1696474821124 heartbeating to localhost/127.0.0.1:34213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 03:02:49,926 WARN [BP-891872882-172.31.14.131-1696474821124 heartbeating to localhost/127.0.0.1:34213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891872882-172.31.14.131-1696474821124 (Datanode Uuid 9f99bb15-9072-4003-b9dd-e76635408c49) service to localhost/127.0.0.1:34213 2023-10-05 03:02:49,926 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data3/current/BP-891872882-172.31.14.131-1696474821124] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 03:02:49,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data4/current/BP-891872882-172.31.14.131-1696474821124] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 03:02:49,928 WARN [Listener at jenkins-hbase4.apache.org/40081] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 03:02:49,930 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 03:02:50,033 WARN [BP-891872882-172.31.14.131-1696474821124 heartbeating to localhost/127.0.0.1:34213] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 03:02:50,033 WARN [BP-891872882-172.31.14.131-1696474821124 heartbeating to localhost/127.0.0.1:34213] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-891872882-172.31.14.131-1696474821124 (Datanode Uuid 0b01e733-b3f1-4237-b5b8-0a4ba66bc8ed) service to localhost/127.0.0.1:34213 2023-10-05 03:02:50,034 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data1/current/BP-891872882-172.31.14.131-1696474821124] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 03:02:50,034 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/436f3d9f-e9fa-45c6-6a65-1832575e57ae/cluster_eead2646-7e02-c084-901b-5533b94a85d7/dfs/data/data2/current/BP-891872882-172.31.14.131-1696474821124] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 03:02:50,056 INFO [Listener at jenkins-hbase4.apache.org/40081] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 03:02:50,182 INFO [Listener at jenkins-hbase4.apache.org/40081] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-05 03:02:50,267 INFO [Listener at jenkins-hbase4.apache.org/40081] hbase.HBaseTestingUtility(1293): Minicluster is down