2023-09-15 09:59:50,199 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-15 09:59:50,370 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca 2023-09-15 09:59:50,370 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-15 09:59:50,370 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-15 09:59:50,408 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-15 09:59:50,630 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-15 09:59:50,630 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0, deleteOnExit=true 2023-09-15 09:59:50,631 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-15 09:59:50,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/test.cache.data in system properties and HBase conf 2023-09-15 09:59:50,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop.tmp.dir in system properties and HBase conf 2023-09-15 09:59:50,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop.log.dir in system properties and HBase conf 2023-09-15 09:59:50,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-15 09:59:50,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-15 09:59:50,633 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-15 09:59:50,909 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-15 09:59:50,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-15 09:59:50,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-15 09:59:50,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-15 09:59:50,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 09:59:50,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-15 09:59:50,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-15 09:59:50,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 09:59:50,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 09:59:50,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-15 09:59:50,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/nfs.dump.dir in system properties and HBase conf 2023-09-15 09:59:50,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir in system properties and HBase conf 2023-09-15 09:59:50,916 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 09:59:50,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-15 09:59:50,917 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-15 09:59:51,345 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-15 09:59:51,349 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-15 09:59:51,597 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-15 09:59:51,761 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-15 09:59:51,774 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 09:59:51,807 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 09:59:51,836 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_localhost_43811_hdfs____.6u4jj1/webapp 2023-09-15 09:59:51,944 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43811 2023-09-15 09:59:51,996 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-15 09:59:51,996 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-15 09:59:52,387 WARN [Listener at localhost/38409] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 09:59:52,450 WARN [Listener at localhost/38409] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 09:59:52,467 WARN [Listener at localhost/38409] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 09:59:52,473 INFO [Listener at localhost/38409] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 09:59:52,479 INFO [Listener at localhost/38409] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_localhost_45777_datanode____.i2qvab/webapp 2023-09-15 09:59:52,555 INFO [Listener at localhost/38409] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45777 2023-09-15 09:59:53,008 WARN [Listener at localhost/36299] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 09:59:53,031 WARN [Listener at localhost/36299] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 09:59:53,037 WARN [Listener at localhost/36299] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 09:59:53,039 INFO [Listener at localhost/36299] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 09:59:53,049 INFO [Listener at localhost/36299] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_localhost_36519_datanode____cq6dhd/webapp 2023-09-15 09:59:53,152 INFO [Listener at localhost/36299] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36519 2023-09-15 09:59:53,169 WARN [Listener at localhost/41347] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 09:59:53,187 WARN [Listener at localhost/41347] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-15 09:59:53,191 WARN [Listener at localhost/41347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 09:59:53,193 INFO [Listener at localhost/41347] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 09:59:53,203 INFO [Listener at localhost/41347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_localhost_45607_datanode____fio70j/webapp 2023-09-15 09:59:53,298 INFO [Listener at localhost/41347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45607 2023-09-15 09:59:53,312 WARN [Listener at localhost/42561] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-15 09:59:53,553 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x65f8b66cd6b6b463: Processing first storage report for DS-c6991a98-46f3-49c1-bccf-6ab75891aa29 from datanode f940ce08-a4ec-4b25-8f7a-88744268866c 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x65f8b66cd6b6b463: from storage DS-c6991a98-46f3-49c1-bccf-6ab75891aa29 node DatanodeRegistration(127.0.0.1:33685, datanodeUuid=f940ce08-a4ec-4b25-8f7a-88744268866c, infoPort=43613, infoSecurePort=0, ipcPort=41347, storageInfo=lv=-57;cid=testClusterID;nsid=1161390466;c=1694771991416), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d0bb904b138f5c3: Processing first storage report for DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8 from datanode ec34ad9d-5067-4cb4-b4c2-fefef2ccc5ff 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d0bb904b138f5c3: from storage DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8 node DatanodeRegistration(127.0.0.1:46737, datanodeUuid=ec34ad9d-5067-4cb4-b4c2-fefef2ccc5ff, infoPort=37889, infoSecurePort=0, ipcPort=42561, storageInfo=lv=-57;cid=testClusterID;nsid=1161390466;c=1694771991416), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x422aa2e28a8ad7e6: Processing first storage report for DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5 from datanode 7277f8bf-c42c-4f4d-abf7-a3729c581f51 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x422aa2e28a8ad7e6: from storage DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5 node DatanodeRegistration(127.0.0.1:46661, datanodeUuid=7277f8bf-c42c-4f4d-abf7-a3729c581f51, infoPort=39857, infoSecurePort=0, ipcPort=36299, storageInfo=lv=-57;cid=testClusterID;nsid=1161390466;c=1694771991416), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x65f8b66cd6b6b463: Processing first storage report for DS-dd87e3b4-9700-4fe5-96fc-7e646358559b from datanode f940ce08-a4ec-4b25-8f7a-88744268866c 2023-09-15 09:59:53,555 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x65f8b66cd6b6b463: from storage DS-dd87e3b4-9700-4fe5-96fc-7e646358559b node DatanodeRegistration(127.0.0.1:33685, datanodeUuid=f940ce08-a4ec-4b25-8f7a-88744268866c, infoPort=43613, infoSecurePort=0, ipcPort=41347, storageInfo=lv=-57;cid=testClusterID;nsid=1161390466;c=1694771991416), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 09:59:53,556 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d0bb904b138f5c3: Processing first storage report for DS-9a5da484-8493-405a-99b4-1451882dd031 from datanode ec34ad9d-5067-4cb4-b4c2-fefef2ccc5ff 2023-09-15 09:59:53,556 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d0bb904b138f5c3: from storage DS-9a5da484-8493-405a-99b4-1451882dd031 node DatanodeRegistration(127.0.0.1:46737, datanodeUuid=ec34ad9d-5067-4cb4-b4c2-fefef2ccc5ff, infoPort=37889, infoSecurePort=0, ipcPort=42561, storageInfo=lv=-57;cid=testClusterID;nsid=1161390466;c=1694771991416), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 09:59:53,556 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x422aa2e28a8ad7e6: Processing first storage report for DS-e1d89602-524d-49a3-a4ea-ab45c1887aa0 from datanode 7277f8bf-c42c-4f4d-abf7-a3729c581f51 2023-09-15 09:59:53,556 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x422aa2e28a8ad7e6: from storage DS-e1d89602-524d-49a3-a4ea-ab45c1887aa0 node DatanodeRegistration(127.0.0.1:46661, datanodeUuid=7277f8bf-c42c-4f4d-abf7-a3729c581f51, infoPort=39857, infoSecurePort=0, ipcPort=36299, storageInfo=lv=-57;cid=testClusterID;nsid=1161390466;c=1694771991416), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-15 09:59:53,735 DEBUG [Listener at localhost/42561] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca 2023-09-15 09:59:53,805 INFO [Listener at localhost/42561] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/zookeeper_0, clientPort=62768, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-15 09:59:53,821 INFO [Listener at localhost/42561] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62768 2023-09-15 09:59:53,830 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:53,833 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:54,484 INFO [Listener at localhost/42561] util.FSUtils(471): Created version file at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 with version=8 2023-09-15 09:59:54,485 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/hbase-staging 2023-09-15 09:59:54,847 INFO [Listener at localhost/42561] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-15 09:59:55,253 INFO [Listener at localhost/42561] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-09-15 09:59:55,282 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,282 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,282 INFO [Listener at localhost/42561] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 09:59:55,283 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,283 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 09:59:55,411 INFO [Listener at localhost/42561] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 09:59:55,471 DEBUG [Listener at localhost/42561] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-15 09:59:55,552 INFO [Listener at localhost/42561] ipc.NettyRpcServer(120): Bind to /136.243.18.41:34365 2023-09-15 09:59:55,563 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,565 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,584 INFO [Listener at localhost/42561] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34365 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-09-15 09:59:55,633 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:343650x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 09:59:55,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34365-0x100af0697fe0000 connected 2023-09-15 09:59:55,667 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 09:59:55,668 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 09:59:55,680 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 09:59:55,687 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34365 2023-09-15 09:59:55,687 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34365 2023-09-15 09:59:55,688 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34365 2023-09-15 09:59:55,688 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34365 2023-09-15 09:59:55,688 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34365 2023-09-15 09:59:55,694 INFO [Listener at localhost/42561] master.HMaster(444): hbase.rootdir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, hbase.cluster.distributed=false 2023-09-15 09:59:55,749 INFO [Listener at localhost/42561] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-15 09:59:55,749 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,749 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,750 INFO [Listener at localhost/42561] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 09:59:55,750 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,750 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 09:59:55,754 INFO [Listener at localhost/42561] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 09:59:55,757 INFO [Listener at localhost/42561] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35307 2023-09-15 09:59:55,759 INFO [Listener at localhost/42561] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 09:59:55,765 INFO [Listener at localhost/42561] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 09:59:55,766 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,768 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,770 INFO [Listener at localhost/42561] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35307 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-09-15 09:59:55,776 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:353070x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 09:59:55,777 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:353070x0, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 09:59:55,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35307-0x100af0697fe0001 connected 2023-09-15 09:59:55,779 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 09:59:55,780 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 09:59:55,780 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35307 2023-09-15 09:59:55,780 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35307 2023-09-15 09:59:55,781 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35307 2023-09-15 09:59:55,781 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35307 2023-09-15 09:59:55,785 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35307 2023-09-15 09:59:55,796 INFO [Listener at localhost/42561] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-15 09:59:55,796 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,796 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,797 INFO [Listener at localhost/42561] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 09:59:55,797 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,797 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 09:59:55,797 INFO [Listener at localhost/42561] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 09:59:55,799 INFO [Listener at localhost/42561] ipc.NettyRpcServer(120): Bind to /136.243.18.41:46549 2023-09-15 09:59:55,800 INFO [Listener at localhost/42561] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 09:59:55,801 INFO [Listener at localhost/42561] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 09:59:55,802 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,805 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,809 INFO [Listener at localhost/42561] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46549 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-09-15 09:59:55,812 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:465490x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 09:59:55,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46549-0x100af0697fe0002 connected 2023-09-15 09:59:55,813 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 09:59:55,814 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 09:59:55,815 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 09:59:55,818 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46549 2023-09-15 09:59:55,818 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46549 2023-09-15 09:59:55,819 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46549 2023-09-15 09:59:55,821 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46549 2023-09-15 09:59:55,821 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46549 2023-09-15 09:59:55,832 INFO [Listener at localhost/42561] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-09-15 09:59:55,832 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,832 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,832 INFO [Listener at localhost/42561] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-15 09:59:55,832 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-15 09:59:55,832 INFO [Listener at localhost/42561] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-15 09:59:55,833 INFO [Listener at localhost/42561] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-15 09:59:55,834 INFO [Listener at localhost/42561] ipc.NettyRpcServer(120): Bind to /136.243.18.41:34885 2023-09-15 09:59:55,834 INFO [Listener at localhost/42561] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-15 09:59:55,835 INFO [Listener at localhost/42561] mob.MobFileCache(124): MobFileCache disabled 2023-09-15 09:59:55,836 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,837 INFO [Listener at localhost/42561] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:55,839 INFO [Listener at localhost/42561] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34885 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-09-15 09:59:55,842 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:348850x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-15 09:59:55,843 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:348850x0, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 09:59:55,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34885-0x100af0697fe0003 connected 2023-09-15 09:59:55,844 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 09:59:55,845 DEBUG [Listener at localhost/42561] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-15 09:59:55,848 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34885 2023-09-15 09:59:55,849 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34885 2023-09-15 09:59:55,849 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34885 2023-09-15 09:59:55,851 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34885 2023-09-15 09:59:55,853 DEBUG [Listener at localhost/42561] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34885 2023-09-15 09:59:55,854 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:55,862 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-15 09:59:55,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:55,883 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 09:59:55,883 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 09:59:55,883 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 09:59:55,883 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-15 09:59:55,884 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:55,885 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-15 09:59:55,886 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,34365,1694771994680 from backup master directory 2023-09-15 09:59:55,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-15 09:59:55,891 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:55,891 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-15 09:59:55,892 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 09:59:55,892 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:55,895 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-15 09:59:55,896 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-15 09:59:55,996 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/hbase.id with ID: c93a60fc-fb4e-4d0b-bb48-a14a3c57496a 2023-09-15 09:59:56,045 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-15 09:59:56,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:56,107 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x71b42254 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 09:59:56,141 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f9fb712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 09:59:56,164 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-15 09:59:56,165 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-15 09:59:56,180 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-15 09:59:56,180 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-15 09:59:56,182 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-15 09:59:56,186 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-15 09:59:56,187 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 09:59:56,218 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store-tmp 2023-09-15 09:59:56,257 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:56,257 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-15 09:59:56,257 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 09:59:56,257 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 09:59:56,258 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-15 09:59:56,258 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 09:59:56,258 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 09:59:56,258 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 09:59:56,260 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/WALs/jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:56,289 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C34365%2C1694771994680, suffix=, logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/WALs/jenkins-hbase17.apache.org,34365,1694771994680, archiveDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/oldWALs, maxLogs=10 2023-09-15 09:59:56,341 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK] 2023-09-15 09:59:56,341 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK] 2023-09-15 09:59:56,341 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK] 2023-09-15 09:59:56,349 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-15 09:59:56,409 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/WALs/jenkins-hbase17.apache.org,34365,1694771994680/jenkins-hbase17.apache.org%2C34365%2C1694771994680.1694771996299 2023-09-15 09:59:56,410 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK], DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK], DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK]] 2023-09-15 09:59:56,410 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-15 09:59:56,411 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:56,414 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 09:59:56,415 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 09:59:56,473 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-15 09:59:56,479 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-15 09:59:56,506 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-15 09:59:56,520 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:56,525 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-15 09:59:56,527 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-15 09:59:56,541 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-15 09:59:56,546 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 09:59:56,547 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65273960, jitterRate=-0.02734220027923584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 09:59:56,547 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 09:59:56,549 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-15 09:59:56,568 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-15 09:59:56,568 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-15 09:59:56,570 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-15 09:59:56,572 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-15 09:59:56,601 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 29 msec 2023-09-15 09:59:56,601 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-15 09:59:56,626 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-15 09:59:56,632 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-15 09:59:56,654 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-15 09:59:56,659 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-15 09:59:56,660 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-15 09:59:56,666 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-15 09:59:56,670 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-15 09:59:56,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:56,675 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-15 09:59:56,675 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-15 09:59:56,688 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-15 09:59:56,693 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 09:59:56,693 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 09:59:56,693 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 09:59:56,693 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-15 09:59:56,693 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:56,693 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,34365,1694771994680, sessionid=0x100af0697fe0000, setting cluster-up flag (Was=false) 2023-09-15 09:59:56,707 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:56,710 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-15 09:59:56,712 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:56,716 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:56,720 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-15 09:59:56,721 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:56,724 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp 2023-09-15 09:59:56,767 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(951): ClusterId : c93a60fc-fb4e-4d0b-bb48-a14a3c57496a 2023-09-15 09:59:56,767 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(951): ClusterId : c93a60fc-fb4e-4d0b-bb48-a14a3c57496a 2023-09-15 09:59:56,768 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(951): ClusterId : c93a60fc-fb4e-4d0b-bb48-a14a3c57496a 2023-09-15 09:59:56,774 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 09:59:56,774 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 09:59:56,774 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-15 09:59:56,780 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 09:59:56,780 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 09:59:56,780 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-15 09:59:56,780 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 09:59:56,780 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 09:59:56,780 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-15 09:59:56,784 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 09:59:56,784 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 09:59:56,784 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-15 09:59:56,791 DEBUG [RS:0;jenkins-hbase17:35307] zookeeper.ReadOnlyZKClient(139): Connect 0x354f4d9d to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 09:59:56,791 DEBUG [RS:2;jenkins-hbase17:34885] zookeeper.ReadOnlyZKClient(139): Connect 0x08ef32fb to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 09:59:56,795 DEBUG [RS:1;jenkins-hbase17:46549] zookeeper.ReadOnlyZKClient(139): Connect 0x36ee0fba to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 09:59:56,813 DEBUG [RS:2;jenkins-hbase17:34885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@628dd96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 09:59:56,814 DEBUG [RS:2;jenkins-hbase17:34885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@217598b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-15 09:59:56,830 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-15 09:59:56,843 DEBUG [RS:0;jenkins-hbase17:35307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b88a544, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 09:59:56,843 DEBUG [RS:0;jenkins-hbase17:35307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fb726ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-15 09:59:56,844 DEBUG [RS:1;jenkins-hbase17:46549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3829e717, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 09:59:56,844 DEBUG [RS:1;jenkins-hbase17:46549] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1664ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-15 09:59:56,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:56,846 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-15 09:59:56,872 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:35307 2023-09-15 09:59:56,872 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:34885 2023-09-15 09:59:56,872 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:46549 2023-09-15 09:59:56,878 INFO [RS:0;jenkins-hbase17:35307] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 09:59:56,878 INFO [RS:2;jenkins-hbase17:34885] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 09:59:56,878 INFO [RS:1;jenkins-hbase17:46549] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-15 09:59:56,879 INFO [RS:2;jenkins-hbase17:34885] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 09:59:56,879 INFO [RS:0;jenkins-hbase17:35307] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 09:59:56,879 INFO [RS:1;jenkins-hbase17:46549] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-15 09:59:56,879 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 09:59:56,879 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 09:59:56,879 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-15 09:59:56,881 INFO [RS:1;jenkins-hbase17:46549] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:56,882 INFO [RS:2;jenkins-hbase17:34885] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:56,882 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 09:59:56,882 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 09:59:56,881 INFO [RS:0;jenkins-hbase17:35307] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:56,882 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1022): About to register with Master. 2023-09-15 09:59:56,885 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,34365,1694771994680 with isa=jenkins-hbase17.apache.org/136.243.18.41:35307, startcode=1694771995748 2023-09-15 09:59:56,885 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,34365,1694771994680 with isa=jenkins-hbase17.apache.org/136.243.18.41:34885, startcode=1694771995831 2023-09-15 09:59:56,886 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,34365,1694771994680 with isa=jenkins-hbase17.apache.org/136.243.18.41:46549, startcode=1694771995795 2023-09-15 09:59:56,908 DEBUG [RS:2;jenkins-hbase17:34885] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 09:59:56,908 DEBUG [RS:1;jenkins-hbase17:46549] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 09:59:56,908 DEBUG [RS:0;jenkins-hbase17:35307] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-15 09:59:56,930 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-15 09:59:56,946 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:56,949 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694772026949 2023-09-15 09:59:56,952 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-15 09:59:56,954 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-15 09:59:56,955 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-15 09:59:56,959 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 09:59:56,962 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-15 09:59:56,965 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56087, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 09:59:56,965 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47367, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 09:59:56,965 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57099, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-15 09:59:56,976 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-15 09:59:56,977 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-15 09:59:56,977 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-15 09:59:56,977 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-15 09:59:56,978 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:56,978 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34365] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 09:59:56,980 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-15 09:59:56,982 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-15 09:59:56,982 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-15 09:59:56,986 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-15 09:59:56,986 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-15 09:59:56,987 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34365] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 09:59:56,988 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34365] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-15 09:59:56,992 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1694771996990,5,FailOnTimeoutGroup] 2023-09-15 09:59:56,999 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1694771996994,5,FailOnTimeoutGroup] 2023-09-15 09:59:56,999 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:56,999 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-15 09:59:57,001 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,001 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,020 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-15 09:59:57,021 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 09:59:57,021 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 09:59:57,021 WARN [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 09:59:57,021 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-15 09:59:57,021 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(2830): Master is not running yet 2023-09-15 09:59:57,021 WARN [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 09:59:57,021 WARN [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-15 09:59:57,022 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 09:59:57,045 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:57,048 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-15 09:59:57,050 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/info 2023-09-15 09:59:57,051 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-15 09:59:57,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:57,052 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-15 09:59:57,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/rep_barrier 2023-09-15 09:59:57,055 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-15 09:59:57,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:57,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-15 09:59:57,058 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/table 2023-09-15 09:59:57,058 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-15 09:59:57,059 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:57,061 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740 2023-09-15 09:59:57,062 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740 2023-09-15 09:59:57,065 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-15 09:59:57,067 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-15 09:59:57,071 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 09:59:57,072 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71600775, jitterRate=0.06693468987941742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-15 09:59:57,072 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-15 09:59:57,072 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-15 09:59:57,072 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-15 09:59:57,072 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-15 09:59:57,072 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-15 09:59:57,072 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-15 09:59:57,074 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-15 09:59:57,074 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-15 09:59:57,079 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-15 09:59:57,079 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-15 09:59:57,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-15 09:59:57,099 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-15 09:59:57,102 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-15 09:59:57,122 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,34365,1694771994680 with isa=jenkins-hbase17.apache.org/136.243.18.41:34885, startcode=1694771995831 2023-09-15 09:59:57,123 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,34365,1694771994680 with isa=jenkins-hbase17.apache.org/136.243.18.41:35307, startcode=1694771995748 2023-09-15 09:59:57,122 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,34365,1694771994680 with isa=jenkins-hbase17.apache.org/136.243.18.41:46549, startcode=1694771995795 2023-09-15 09:59:57,127 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34365] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,132 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34365] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,133 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 09:59:57,133 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34365] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,133 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38409 2023-09-15 09:59:57,134 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 09:59:57,134 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 09:59:57,134 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38409 2023-09-15 09:59:57,134 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 09:59:57,135 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 09:59:57,135 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38409 2023-09-15 09:59:57,135 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-15 09:59:57,141 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 09:59:57,141 DEBUG [RS:1;jenkins-hbase17:46549] zookeeper.ZKUtil(162): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,141 DEBUG [RS:0;jenkins-hbase17:35307] zookeeper.ZKUtil(162): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,142 WARN [RS:1;jenkins-hbase17:46549] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 09:59:57,142 WARN [RS:0;jenkins-hbase17:35307] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 09:59:57,142 DEBUG [RS:2;jenkins-hbase17:34885] zookeeper.ZKUtil(162): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,142 INFO [RS:1;jenkins-hbase17:46549] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 09:59:57,143 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,143 WARN [RS:2;jenkins-hbase17:34885] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-15 09:59:57,142 INFO [RS:0;jenkins-hbase17:35307] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 09:59:57,143 INFO [RS:2;jenkins-hbase17:34885] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 09:59:57,143 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,143 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,146 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,35307,1694771995748] 2023-09-15 09:59:57,146 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,34885,1694771995831] 2023-09-15 09:59:57,146 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,46549,1694771995795] 2023-09-15 09:59:57,156 DEBUG [RS:1;jenkins-hbase17:46549] zookeeper.ZKUtil(162): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,156 DEBUG [RS:0;jenkins-hbase17:35307] zookeeper.ZKUtil(162): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,156 DEBUG [RS:2;jenkins-hbase17:34885] zookeeper.ZKUtil(162): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,156 DEBUG [RS:1;jenkins-hbase17:46549] zookeeper.ZKUtil(162): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,157 DEBUG [RS:0;jenkins-hbase17:35307] zookeeper.ZKUtil(162): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,157 DEBUG [RS:2;jenkins-hbase17:34885] zookeeper.ZKUtil(162): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,157 DEBUG [RS:1;jenkins-hbase17:46549] zookeeper.ZKUtil(162): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,157 DEBUG [RS:0;jenkins-hbase17:35307] zookeeper.ZKUtil(162): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,157 DEBUG [RS:2;jenkins-hbase17:34885] zookeeper.ZKUtil(162): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,167 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 09:59:57,167 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 09:59:57,167 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-15 09:59:57,176 INFO [RS:0;jenkins-hbase17:35307] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 09:59:57,176 INFO [RS:2;jenkins-hbase17:34885] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 09:59:57,176 INFO [RS:1;jenkins-hbase17:46549] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-15 09:59:57,198 INFO [RS:2;jenkins-hbase17:34885] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 09:59:57,199 INFO [RS:0;jenkins-hbase17:35307] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 09:59:57,200 INFO [RS:1;jenkins-hbase17:46549] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-15 09:59:57,202 INFO [RS:1;jenkins-hbase17:46549] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 09:59:57,203 INFO [RS:0;jenkins-hbase17:35307] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 09:59:57,202 INFO [RS:2;jenkins-hbase17:34885] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-15 09:59:57,203 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,203 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,203 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,203 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 09:59:57,204 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 09:59:57,204 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-15 09:59:57,212 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,212 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,212 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,213 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,213 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-15 09:59:57,214 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-15 09:59:57,214 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-09-15 09:59:57,214 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,214 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:1;jenkins-hbase17:46549] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,215 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,216 DEBUG [RS:2;jenkins-hbase17:34885] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,216 DEBUG [RS:0;jenkins-hbase17:35307] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-09-15 09:59:57,217 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,218 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,218 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,225 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,225 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,225 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,225 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,225 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,226 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,240 INFO [RS:1;jenkins-hbase17:46549] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 09:59:57,240 INFO [RS:0;jenkins-hbase17:35307] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 09:59:57,240 INFO [RS:2;jenkins-hbase17:34885] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-15 09:59:57,243 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,46549,1694771995795-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,243 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35307,1694771995748-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,243 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34885,1694771995831-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,254 DEBUG [jenkins-hbase17:34365] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-15 09:59:57,260 DEBUG [jenkins-hbase17:34365] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 09:59:57,264 INFO [RS:2;jenkins-hbase17:34885] regionserver.Replication(203): jenkins-hbase17.apache.org,34885,1694771995831 started 2023-09-15 09:59:57,264 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,34885,1694771995831, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:34885, sessionid=0x100af0697fe0003 2023-09-15 09:59:57,264 INFO [RS:1;jenkins-hbase17:46549] regionserver.Replication(203): jenkins-hbase17.apache.org,46549,1694771995795 started 2023-09-15 09:59:57,264 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 09:59:57,265 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,46549,1694771995795, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:46549, sessionid=0x100af0697fe0002 2023-09-15 09:59:57,265 DEBUG [RS:2;jenkins-hbase17:34885] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,265 DEBUG [RS:2;jenkins-hbase17:34885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,34885,1694771995831' 2023-09-15 09:59:57,265 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 09:59:57,265 INFO [RS:0;jenkins-hbase17:35307] regionserver.Replication(203): jenkins-hbase17.apache.org,35307,1694771995748 started 2023-09-15 09:59:57,272 DEBUG [jenkins-hbase17:34365] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 09:59:57,265 DEBUG [RS:1;jenkins-hbase17:46549] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,265 DEBUG [RS:2;jenkins-hbase17:34885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 09:59:57,273 DEBUG [RS:1;jenkins-hbase17:46549] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,46549,1694771995795' 2023-09-15 09:59:57,274 DEBUG [RS:1;jenkins-hbase17:46549] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 09:59:57,273 DEBUG [jenkins-hbase17:34365] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 09:59:57,274 DEBUG [jenkins-hbase17:34365] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 09:59:57,274 DEBUG [jenkins-hbase17:34365] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 09:59:57,273 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,35307,1694771995748, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:35307, sessionid=0x100af0697fe0001 2023-09-15 09:59:57,275 DEBUG [RS:1;jenkins-hbase17:46549] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 09:59:57,275 DEBUG [RS:2;jenkins-hbase17:34885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 09:59:57,275 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 09:59:57,275 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 09:59:57,275 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 09:59:57,275 DEBUG [RS:2;jenkins-hbase17:34885] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:57,276 DEBUG [RS:2;jenkins-hbase17:34885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,34885,1694771995831' 2023-09-15 09:59:57,276 DEBUG [RS:2;jenkins-hbase17:34885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 09:59:57,275 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-15 09:59:57,275 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 09:59:57,276 DEBUG [RS:0;jenkins-hbase17:35307] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,276 DEBUG [RS:1;jenkins-hbase17:46549] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:57,281 DEBUG [RS:2;jenkins-hbase17:34885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 09:59:57,281 DEBUG [RS:2;jenkins-hbase17:34885] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 09:59:57,281 INFO [RS:2;jenkins-hbase17:34885] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 09:59:57,281 INFO [RS:2;jenkins-hbase17:34885] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 09:59:57,281 DEBUG [RS:0;jenkins-hbase17:35307] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35307,1694771995748' 2023-09-15 09:59:57,281 DEBUG [RS:1;jenkins-hbase17:46549] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,46549,1694771995795' 2023-09-15 09:59:57,282 DEBUG [RS:1;jenkins-hbase17:46549] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 09:59:57,282 DEBUG [RS:0;jenkins-hbase17:35307] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-15 09:59:57,282 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,35307,1694771995748, state=OPENING 2023-09-15 09:59:57,282 DEBUG [RS:1;jenkins-hbase17:46549] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 09:59:57,283 DEBUG [RS:0;jenkins-hbase17:35307] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-15 09:59:57,283 DEBUG [RS:1;jenkins-hbase17:46549] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 09:59:57,283 INFO [RS:1;jenkins-hbase17:46549] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 09:59:57,284 INFO [RS:1;jenkins-hbase17:46549] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 09:59:57,284 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-15 09:59:57,284 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-15 09:59:57,284 DEBUG [RS:0;jenkins-hbase17:35307] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,284 DEBUG [RS:0;jenkins-hbase17:35307] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35307,1694771995748' 2023-09-15 09:59:57,284 DEBUG [RS:0;jenkins-hbase17:35307] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 09:59:57,285 DEBUG [RS:0;jenkins-hbase17:35307] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 09:59:57,285 DEBUG [RS:0;jenkins-hbase17:35307] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-15 09:59:57,285 INFO [RS:0;jenkins-hbase17:35307] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-15 09:59:57,285 INFO [RS:0;jenkins-hbase17:35307] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-15 09:59:57,290 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-15 09:59:57,291 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:57,291 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-15 09:59:57,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 09:59:57,391 INFO [RS:2;jenkins-hbase17:34885] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C34885%2C1694771995831, suffix=, logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,34885,1694771995831, archiveDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs, maxLogs=32 2023-09-15 09:59:57,391 INFO [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35307%2C1694771995748, suffix=, logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,35307,1694771995748, archiveDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs, maxLogs=32 2023-09-15 09:59:57,391 INFO [RS:1;jenkins-hbase17:46549] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C46549%2C1694771995795, suffix=, logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,46549,1694771995795, archiveDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs, maxLogs=32 2023-09-15 09:59:57,417 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK] 2023-09-15 09:59:57,417 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK] 2023-09-15 09:59:57,417 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK] 2023-09-15 09:59:57,430 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK] 2023-09-15 09:59:57,431 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK] 2023-09-15 09:59:57,432 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK] 2023-09-15 09:59:57,432 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK] 2023-09-15 09:59:57,433 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK] 2023-09-15 09:59:57,433 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK] 2023-09-15 09:59:57,435 INFO [RS:1;jenkins-hbase17:46549] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,46549,1694771995795/jenkins-hbase17.apache.org%2C46549%2C1694771995795.1694771997395 2023-09-15 09:59:57,438 DEBUG [RS:1;jenkins-hbase17:46549] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK], DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK], DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK]] 2023-09-15 09:59:57,442 INFO [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,35307,1694771995748/jenkins-hbase17.apache.org%2C35307%2C1694771995748.1694771997396 2023-09-15 09:59:57,444 INFO [RS:2;jenkins-hbase17:34885] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,34885,1694771995831/jenkins-hbase17.apache.org%2C34885%2C1694771995831.1694771997396 2023-09-15 09:59:57,445 DEBUG [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK], DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK], DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK]] 2023-09-15 09:59:57,445 DEBUG [RS:2;jenkins-hbase17:34885] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK], DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK], DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK]] 2023-09-15 09:59:57,479 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 09:59:57,481 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 09:59:57,484 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 09:59:57,496 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-15 09:59:57,496 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-15 09:59:57,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35307%2C1694771995748.meta, suffix=.meta, logDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,35307,1694771995748, archiveDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs, maxLogs=32 2023-09-15 09:59:57,519 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK] 2023-09-15 09:59:57,519 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK] 2023-09-15 09:59:57,520 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK] 2023-09-15 09:59:57,526 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/WALs/jenkins-hbase17.apache.org,35307,1694771995748/jenkins-hbase17.apache.org%2C35307%2C1694771995748.meta.1694771997501.meta 2023-09-15 09:59:57,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33685,DS-c6991a98-46f3-49c1-bccf-6ab75891aa29,DISK], DatanodeInfoWithStorage[127.0.0.1:46661,DS-bfebf389-91ef-47c7-b2d2-fb84e57cb8a5,DISK], DatanodeInfoWithStorage[127.0.0.1:46737,DS-636dd0c5-0601-49a0-9a3e-c20c602a92c8,DISK]] 2023-09-15 09:59:57,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-15 09:59:57,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-15 09:59:57,530 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:57,531 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-15 09:59:57,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-15 09:59:57,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-15 09:59:57,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-15 09:59:57,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:57,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-15 09:59:57,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-15 09:59:57,555 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-15 09:59:57,558 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/info 2023-09-15 09:59:57,558 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/info 2023-09-15 09:59:57,558 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-15 09:59:57,559 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:57,559 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-15 09:59:57,561 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/rep_barrier 2023-09-15 09:59:57,561 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/rep_barrier 2023-09-15 09:59:57,564 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-15 09:59:57,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:57,566 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-15 09:59:57,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/table 2023-09-15 09:59:57,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/table 2023-09-15 09:59:57,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-15 09:59:57,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:57,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740 2023-09-15 09:59:57,576 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740 2023-09-15 09:59:57,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-15 09:59:57,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-15 09:59:57,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69570662, jitterRate=0.03668364882469177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-15 09:59:57,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-15 09:59:57,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694771997473 2023-09-15 09:59:57,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-15 09:59:57,628 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-15 09:59:57,628 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,35307,1694771995748, state=OPEN 2023-09-15 09:59:57,632 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-15 09:59:57,632 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-15 09:59:57,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-15 09:59:57,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35307,1694771995748 in 337 msec 2023-09-15 09:59:57,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-15 09:59:57,645 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 552 msec 2023-09-15 09:59:57,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 794 msec 2023-09-15 09:59:57,651 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694771997651, completionTime=-1 2023-09-15 09:59:57,651 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-15 09:59:57,651 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-15 09:59:57,711 DEBUG [hconnection-0x3d8804f9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 09:59:57,714 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 09:59:57,741 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-15 09:59:57,741 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694772057741 2023-09-15 09:59:57,742 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694772117741 2023-09-15 09:59:57,742 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 90 msec 2023-09-15 09:59:57,765 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34365,1694771994680-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,765 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34365,1694771994680-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,766 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34365,1694771994680-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,771 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:34365, period=300000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,774 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-15 09:59:57,781 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-15 09:59:57,788 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-15 09:59:57,790 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 09:59:57,799 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-15 09:59:57,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 09:59:57,805 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 09:59:57,825 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/namespace/21267cebff037eaed659367339c352ce 2023-09-15 09:59:57,828 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/namespace/21267cebff037eaed659367339c352ce empty. 2023-09-15 09:59:57,828 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/namespace/21267cebff037eaed659367339c352ce 2023-09-15 09:59:57,829 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-15 09:59:57,871 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-15 09:59:57,873 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 21267cebff037eaed659367339c352ce, NAME => 'hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 09:59:57,896 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:57,896 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 21267cebff037eaed659367339c352ce, disabling compactions & flushes 2023-09-15 09:59:57,897 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:57,897 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:57,897 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. after waiting 0 ms 2023-09-15 09:59:57,897 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:57,897 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:57,897 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 21267cebff037eaed659367339c352ce: 2023-09-15 09:59:57,902 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 09:59:57,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694771997905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694771997905"}]},"ts":"1694771997905"} 2023-09-15 09:59:57,941 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-15 09:59:57,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 09:59:57,947 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694771997943"}]},"ts":"1694771997943"} 2023-09-15 09:59:57,952 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-15 09:59:57,955 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 09:59:57,957 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 09:59:57,957 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 09:59:57,957 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 09:59:57,957 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 09:59:57,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=21267cebff037eaed659367339c352ce, ASSIGN}] 2023-09-15 09:59:57,963 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=21267cebff037eaed659367339c352ce, ASSIGN 2023-09-15 09:59:57,965 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=21267cebff037eaed659367339c352ce, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 09:59:58,117 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 09:59:58,118 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=21267cebff037eaed659367339c352ce, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:58,118 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694771998118"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694771998118"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694771998118"}]},"ts":"1694771998118"} 2023-09-15 09:59:58,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 21267cebff037eaed659367339c352ce, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 09:59:58,277 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:58,277 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 09:59:58,282 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 09:59:58,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:58,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21267cebff037eaed659367339c352ce, NAME => 'hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.', STARTKEY => '', ENDKEY => ''} 2023-09-15 09:59:58,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. service=AccessControlService 2023-09-15 09:59:58,294 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:58,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:58,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,298 INFO [StoreOpener-21267cebff037eaed659367339c352ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,301 DEBUG [StoreOpener-21267cebff037eaed659367339c352ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/info 2023-09-15 09:59:58,301 DEBUG [StoreOpener-21267cebff037eaed659367339c352ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/info 2023-09-15 09:59:58,302 INFO [StoreOpener-21267cebff037eaed659367339c352ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21267cebff037eaed659367339c352ce columnFamilyName info 2023-09-15 09:59:58,303 INFO [StoreOpener-21267cebff037eaed659367339c352ce-1] regionserver.HStore(310): Store=21267cebff037eaed659367339c352ce/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:58,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,307 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,311 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 21267cebff037eaed659367339c352ce 2023-09-15 09:59:58,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 09:59:58,317 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 21267cebff037eaed659367339c352ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68467323, jitterRate=0.020242616534233093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 09:59:58,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 21267cebff037eaed659367339c352ce: 2023-09-15 09:59:58,319 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce., pid=6, masterSystemTime=1694771998277 2023-09-15 09:59:58,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:58,325 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 09:59:58,326 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=21267cebff037eaed659367339c352ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 09:59:58,327 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694771998326"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694771998326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694771998326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694771998326"}]},"ts":"1694771998326"} 2023-09-15 09:59:58,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-15 09:59:58,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 21267cebff037eaed659367339c352ce, server=jenkins-hbase17.apache.org,46549,1694771995795 in 208 msec 2023-09-15 09:59:58,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-15 09:59:58,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=21267cebff037eaed659367339c352ce, ASSIGN in 380 msec 2023-09-15 09:59:58,345 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 09:59:58,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694771998345"}]},"ts":"1694771998345"} 2023-09-15 09:59:58,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-15 09:59:58,351 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 09:59:58,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 560 msec 2023-09-15 09:59:58,402 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-15 09:59:58,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-15 09:59:58,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 09:59:58,425 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 09:59:58,428 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 09:59:58,444 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-15 09:59:58,464 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-15 09:59:58,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-09-15 09:59:58,478 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-15 09:59:58,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-15 09:59:58,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-15 09:59:58,504 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-15 09:59:58,505 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-15 09:59:58,506 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.614sec 2023-09-15 09:59:58,509 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-15 09:59:58,511 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-15 09:59:58,511 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-15 09:59:58,513 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34365,1694771994680-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-15 09:59:58,514 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,34365,1694771994680-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-15 09:59:58,540 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-15 09:59:58,542 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-15 09:59:58,545 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 09:59:58,546 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 09:59:58,549 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-15 09:59:58,549 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:58,550 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d empty. 2023-09-15 09:59:58,553 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:58,553 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-15 09:59:58,557 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 09:59:58,608 DEBUG [Listener at localhost/42561] zookeeper.ReadOnlyZKClient(139): Connect 0x326622aa to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 09:59:58,608 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-15 09:59:58,610 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5ef49b271892c1fa4f5f16fa971b457d, NAME => 'hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 09:59:58,619 DEBUG [Listener at localhost/42561] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f1e3164, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 09:59:58,640 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:58,641 DEBUG [hconnection-0x178bf7aa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 09:59:58,641 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5ef49b271892c1fa4f5f16fa971b457d, disabling compactions & flushes 2023-09-15 09:59:58,641 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:58,641 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:58,641 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. after waiting 0 ms 2023-09-15 09:59:58,641 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:58,641 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:58,641 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5ef49b271892c1fa4f5f16fa971b457d: 2023-09-15 09:59:58,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 09:59:58,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694771998650"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694771998650"}]},"ts":"1694771998650"} 2023-09-15 09:59:58,654 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-15 09:59:58,657 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 09:59:58,657 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 09:59:58,657 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694771998657"}]},"ts":"1694771998657"} 2023-09-15 09:59:58,659 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/test.cache.data in system properties and HBase conf 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop.tmp.dir in system properties and HBase conf 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop.log.dir in system properties and HBase conf 2023-09-15 09:59:58,660 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-15 09:59:58,660 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-15 09:59:58,661 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/nfs.dump.dir in system properties and HBase conf 2023-09-15 09:59:58,661 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir in system properties and HBase conf 2023-09-15 09:59:58,662 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-15 09:59:58,662 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-15 09:59:58,662 INFO [Listener at localhost/42561] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-15 09:59:58,663 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 09:59:58,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 09:59:58,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 09:59:58,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 09:59:58,664 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 09:59:58,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5ef49b271892c1fa4f5f16fa971b457d, ASSIGN}] 2023-09-15 09:59:58,668 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5ef49b271892c1fa4f5f16fa971b457d, ASSIGN 2023-09-15 09:59:58,669 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5ef49b271892c1fa4f5f16fa971b457d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34885,1694771995831; forceNewPlan=false, retain=false 2023-09-15 09:59:58,820 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 09:59:58,821 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5ef49b271892c1fa4f5f16fa971b457d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:58,821 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694771998821"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694771998821"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694771998821"}]},"ts":"1694771998821"} 2023-09-15 09:59:58,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5ef49b271892c1fa4f5f16fa971b457d, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 09:59:58,861 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 09:59:58,979 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:58,979 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 09:59:58,980 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 09:59:58,987 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:58,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ef49b271892c1fa4f5f16fa971b457d, NAME => 'hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.', STARTKEY => '', ENDKEY => ''} 2023-09-15 09:59:58,987 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. service=AccessControlService 2023-09-15 09:59:58,988 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 09:59:58,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:58,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 09:59:58,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:58,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:58,990 INFO [StoreOpener-5ef49b271892c1fa4f5f16fa971b457d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:58,993 DEBUG [StoreOpener-5ef49b271892c1fa4f5f16fa971b457d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/l 2023-09-15 09:59:58,993 DEBUG [StoreOpener-5ef49b271892c1fa4f5f16fa971b457d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/l 2023-09-15 09:59:58,993 INFO [StoreOpener-5ef49b271892c1fa4f5f16fa971b457d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ef49b271892c1fa4f5f16fa971b457d columnFamilyName l 2023-09-15 09:59:58,995 INFO [StoreOpener-5ef49b271892c1fa4f5f16fa971b457d-1] regionserver.HStore(310): Store=5ef49b271892c1fa4f5f16fa971b457d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 09:59:58,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:59,000 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:59,005 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 09:59:59,010 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 09:59:59,011 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5ef49b271892c1fa4f5f16fa971b457d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66717034, jitterRate=-0.005838721990585327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 09:59:59,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5ef49b271892c1fa4f5f16fa971b457d: 2023-09-15 09:59:59,013 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d., pid=11, masterSystemTime=1694771998979 2023-09-15 09:59:59,017 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:59,018 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 09:59:59,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5ef49b271892c1fa4f5f16fa971b457d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 09:59:59,019 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694771999019"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694771999019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694771999019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694771999019"}]},"ts":"1694771999019"} 2023-09-15 09:59:59,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-15 09:59:59,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5ef49b271892c1fa4f5f16fa971b457d, server=jenkins-hbase17.apache.org,34885,1694771995831 in 198 msec 2023-09-15 09:59:59,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-15 09:59:59,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5ef49b271892c1fa4f5f16fa971b457d, ASSIGN in 363 msec 2023-09-15 09:59:59,032 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 09:59:59,033 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694771999033"}]},"ts":"1694771999033"} 2023-09-15 09:59:59,035 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-15 09:59:59,039 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 09:59:59,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 499 msec 2023-09-15 09:59:59,161 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-15 09:59:59,162 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-15 09:59:59,169 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-15 09:59:59,781 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 10:00:00,111 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 10:00:00,117 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_42753_jobhistory____.nn8pec/webapp 2023-09-15 10:00:00,263 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-15 10:00:00,263 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-15 10:00:00,263 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 10:00:00,266 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 10:00:00,337 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:00,614 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:00,876 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-15 10:00:00,902 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:42753 2023-09-15 10:00:01,268 WARN [Listener at jenkins-hbase17.apache.org/44837] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 10:00:01,476 WARN [Listener at jenkins-hbase17.apache.org/44837] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 10:00:01,477 INFO [Listener at jenkins-hbase17.apache.org/44837] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 10:00:01,487 INFO [Listener at jenkins-hbase17.apache.org/44837] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_39229_cluster____.7kulvf/webapp 2023-09-15 10:00:01,549 INFO [Listener at jenkins-hbase17.apache.org/44837] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 10:00:01,549 INFO [Listener at jenkins-hbase17.apache.org/44837] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-15 10:00:01,550 INFO [Listener at jenkins-hbase17.apache.org/44837] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 10:00:01,550 INFO [Listener at jenkins-hbase17.apache.org/44837] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 10:00:01,563 INFO [Listener at jenkins-hbase17.apache.org/44837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:01,784 INFO [Listener at jenkins-hbase17.apache.org/44837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:01,913 INFO [Listener at jenkins-hbase17.apache.org/44837] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:01,924 INFO [Listener at jenkins-hbase17.apache.org/44837] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:39229 2023-09-15 10:00:02,420 WARN [Listener at jenkins-hbase17.apache.org/36919] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 10:00:02,446 WARN [Listener at jenkins-hbase17.apache.org/36919] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 10:00:02,446 INFO [Listener at jenkins-hbase17.apache.org/36919] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 10:00:02,455 INFO [Listener at jenkins-hbase17.apache.org/36919] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_38237_node____awl2ez/webapp 2023-09-15 10:00:02,509 INFO [Listener at jenkins-hbase17.apache.org/36919] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-15 10:00:02,509 INFO [Listener at jenkins-hbase17.apache.org/36919] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 10:00:02,510 INFO [Listener at jenkins-hbase17.apache.org/36919] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 10:00:02,510 INFO [Listener at jenkins-hbase17.apache.org/36919] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 10:00:02,518 INFO [Listener at jenkins-hbase17.apache.org/36919] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:02,535 INFO [Listener at jenkins-hbase17.apache.org/36919] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:02,637 INFO [Listener at jenkins-hbase17.apache.org/36919] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:02,648 INFO [Listener at jenkins-hbase17.apache.org/36919] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:38237 2023-09-15 10:00:02,807 WARN [Listener at jenkins-hbase17.apache.org/42523] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-15 10:00:02,813 WARN [Listener at jenkins-hbase17.apache.org/42523] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-15 10:00:02,813 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): jetty-6.1.26 2023-09-15 10:00:02,823 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40807_node____xi9jcd/webapp 2023-09-15 10:00:02,871 INFO [Listener at jenkins-hbase17.apache.org/42523] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-15 10:00:02,872 INFO [Listener at jenkins-hbase17.apache.org/42523] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-15 10:00:02,872 INFO [Listener at jenkins-hbase17.apache.org/42523] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-15 10:00:02,872 INFO [Listener at jenkins-hbase17.apache.org/42523] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-15 10:00:02,881 INFO [Listener at jenkins-hbase17.apache.org/42523] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:02,895 INFO [Listener at jenkins-hbase17.apache.org/42523] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:02,949 INFO [Listener at jenkins-hbase17.apache.org/42523] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-15 10:00:02,958 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40807 2023-09-15 10:00:02,985 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-15 10:00:02,987 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:03,043 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=141, ProcessCount=168, AvailableMemoryMB=10429 2023-09-15 10:00:03,043 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-09-15 10:00:03,058 DEBUG [Listener at jenkins-hbase17.apache.org/42523] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-15 10:00:03,063 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-15 10:00:03,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 10:00:03,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:03,074 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:00:03,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-15 10:00:03,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 10:00:03,078 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:00:03,081 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,082 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 empty. 2023-09-15 10:00:03,085 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,085 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,091 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 empty. 2023-09-15 10:00:03,092 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,092 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-15 10:00:03,106 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:00:03,158 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-15 10:00:03,162 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e7a012ab726c6c3ee3059937b93c548, NAME => 'testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:00:03,162 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1ff21bd5cdaf1b0fd04568652dda7390, NAME => 'testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:00:03,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 10:00:03,225 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:03,227 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 8e7a012ab726c6c3ee3059937b93c548, disabling compactions & flushes 2023-09-15 10:00:03,227 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,227 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,227 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. after waiting 0 ms 2023-09-15 10:00:03,227 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,227 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,227 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 8e7a012ab726c6c3ee3059937b93c548: 2023-09-15 10:00:03,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:03,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1ff21bd5cdaf1b0fd04568652dda7390, disabling compactions & flushes 2023-09-15 10:00:03,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. after waiting 0 ms 2023-09-15 10:00:03,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1ff21bd5cdaf1b0fd04568652dda7390: 2023-09-15 10:00:03,242 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:00:03,243 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772003243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772003243"}]},"ts":"1694772003243"} 2023-09-15 10:00:03,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772003243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772003243"}]},"ts":"1694772003243"} 2023-09-15 10:00:03,325 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:00:03,327 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:00:03,328 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772003327"}]},"ts":"1694772003327"} 2023-09-15 10:00:03,331 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-15 10:00:03,335 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:00:03,338 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:00:03,338 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:00:03,338 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:00:03,338 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:00:03,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, ASSIGN}] 2023-09-15 10:00:03,343 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, ASSIGN 2023-09-15 10:00:03,344 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, ASSIGN 2023-09-15 10:00:03,346 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:00:03,349 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34885,1694771995831; forceNewPlan=false, retain=false 2023-09-15 10:00:03,352 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-15 10:00:03,354 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-15 10:00:03,355 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-15 10:00:03,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 10:00:03,497 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:00:03,499 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8e7a012ab726c6c3ee3059937b93c548, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:03,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1ff21bd5cdaf1b0fd04568652dda7390, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:03,500 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772003499"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772003499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772003499"}]},"ts":"1694772003499"} 2023-09-15 10:00:03,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772003499"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772003499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772003499"}]},"ts":"1694772003499"} 2023-09-15 10:00:03,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 1ff21bd5cdaf1b0fd04568652dda7390, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 10:00:03,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 8e7a012ab726c6c3ee3059937b93c548, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:00:03,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ff21bd5cdaf1b0fd04568652dda7390, NAME => 'testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 10:00:03,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e7a012ab726c6c3ee3059937b93c548, NAME => 'testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 10:00:03,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. service=AccessControlService 2023-09-15 10:00:03,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. service=AccessControlService 2023-09-15 10:00:03,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:00:03,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:00:03,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,666 INFO [StoreOpener-1ff21bd5cdaf1b0fd04568652dda7390-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,667 INFO [StoreOpener-8e7a012ab726c6c3ee3059937b93c548-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,669 DEBUG [StoreOpener-1ff21bd5cdaf1b0fd04568652dda7390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf 2023-09-15 10:00:03,669 DEBUG [StoreOpener-8e7a012ab726c6c3ee3059937b93c548-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf 2023-09-15 10:00:03,669 DEBUG [StoreOpener-1ff21bd5cdaf1b0fd04568652dda7390-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf 2023-09-15 10:00:03,669 DEBUG [StoreOpener-8e7a012ab726c6c3ee3059937b93c548-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf 2023-09-15 10:00:03,672 INFO [StoreOpener-1ff21bd5cdaf1b0fd04568652dda7390-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff21bd5cdaf1b0fd04568652dda7390 columnFamilyName cf 2023-09-15 10:00:03,672 INFO [StoreOpener-8e7a012ab726c6c3ee3059937b93c548-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e7a012ab726c6c3ee3059937b93c548 columnFamilyName cf 2023-09-15 10:00:03,675 INFO [StoreOpener-8e7a012ab726c6c3ee3059937b93c548-1] regionserver.HStore(310): Store=8e7a012ab726c6c3ee3059937b93c548/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:00:03,675 INFO [StoreOpener-1ff21bd5cdaf1b0fd04568652dda7390-1] regionserver.HStore(310): Store=1ff21bd5cdaf1b0fd04568652dda7390/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:00:03,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:03,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:00:03,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1ff21bd5cdaf1b0fd04568652dda7390; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61688496, jitterRate=-0.08076977729797363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:00:03,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1ff21bd5cdaf1b0fd04568652dda7390: 2023-09-15 10:00:03,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:03,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 10:00:03,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390., pid=15, masterSystemTime=1694772003655 2023-09-15 10:00:03,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:00:03,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8e7a012ab726c6c3ee3059937b93c548; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62102583, jitterRate=-0.07459940016269684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:00:03,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:03,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8e7a012ab726c6c3ee3059937b93c548: 2023-09-15 10:00:03,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548., pid=16, masterSystemTime=1694772003656 2023-09-15 10:00:03,697 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1ff21bd5cdaf1b0fd04568652dda7390, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:03,697 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772003697"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772003697"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772003697"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772003697"}]},"ts":"1694772003697"} 2023-09-15 10:00:03,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:03,700 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=8e7a012ab726c6c3ee3059937b93c548, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:03,701 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772003700"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772003700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772003700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772003700"}]},"ts":"1694772003700"} 2023-09-15 10:00:03,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-15 10:00:03,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 1ff21bd5cdaf1b0fd04568652dda7390, server=jenkins-hbase17.apache.org,34885,1694771995831 in 200 msec 2023-09-15 10:00:03,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-15 10:00:03,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 8e7a012ab726c6c3ee3059937b93c548, server=jenkins-hbase17.apache.org,46549,1694771995795 in 200 msec 2023-09-15 10:00:03,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, ASSIGN in 371 msec 2023-09-15 10:00:03,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-15 10:00:03,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, ASSIGN in 373 msec 2023-09-15 10:00:03,716 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:00:03,717 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772003716"}]},"ts":"1694772003716"} 2023-09-15 10:00:03,719 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-15 10:00:03,722 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:00:03,728 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-15 10:00:03,734 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:03,738 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:03,742 DEBUG [hconnection-0x3d9419f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:03,746 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-15 10:00:03,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 10:00:03,782 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:03,782 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:03,782 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:03,782 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:03,782 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 10:00:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:03,787 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:03,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 718 msec 2023-09-15 10:00:04,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-15 10:00:04,193 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-15 10:00:04,197 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-15 10:00:04,198 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:04,200 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:04,222 DEBUG [hconnection-0x178bf7aa-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,225 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,229 DEBUG [hconnection-0x178bf7aa-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,233 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 10:00:04,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772004250 (current time:1694772004250). 2023-09-15 10:00:04,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:00:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x462ade7d to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:04,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@434f83e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:04,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,262 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x462ade7d to 127.0.0.1:62768 2023-09-15 10:00:04,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:04,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x565d7817 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:04,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c49fa45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:04,273 DEBUG [hconnection-0x1fe051c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,274 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,283 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x565d7817 to 127.0.0.1:62768 2023-09-15 10:00:04,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:04,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 10:00:04,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:00:04,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 10:00:04,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 10:00:04,337 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 10:00:04,338 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694772604338 2023-09-15 10:00:04,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 10:00:04,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-15 10:00:04,342 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 10:00:04,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 10:00:04,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-15 10:00:04,346 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 10:00:04,348 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:00:04,348 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:00:04,348 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694772604348 2023-09-15 10:00:04,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,384 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-15 10:00:04,384 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:04,385 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-15 10:00:04,385 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-15 10:00:04,386 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,386 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,388 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:04,388 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,388 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:04,388 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:04,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:04,388 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:04,388 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,389 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,389 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 10:00:04,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 10:00:04,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 10:00:04,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,394 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 10:00:04,394 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 10:00:04,394 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 10:00:04,395 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:04,394 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:04,396 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 10:00:04,394 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:04,396 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 10:00:04,396 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 10:00:04,397 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 10:00:04,397 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 10:00:04,397 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 10:00:04,397 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-15 10:00:04,397 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 10:00:04,397 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-15 10:00:04,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,403 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:04,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:04,403 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,404 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,403 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,404 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:04,404 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,404 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,404 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:04,404 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:04,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:04,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-15 10:00:04,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b7eb08[Count = 1] remaining members to acquire global barrier 2023-09-15 10:00:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:04,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-15 10:00:04,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b7eb08[Count = 0] remaining members to acquire global barrier 2023-09-15 10:00:04,409 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-15 10:00:04,409 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,411 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 10:00:04,411 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 10:00:04,412 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 10:00:04,411 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,412 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 10:00:04,412 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:00:04,412 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,412 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:00:04,413 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:04,413 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:04,413 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:04,413 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:04,413 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:04,413 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:04,414 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. started... 2023-09-15 10:00:04,415 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 10:00:04,415 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:04,415 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 10:00:04,416 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. started... 2023-09-15 10:00:04,419 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e7a012ab726c6c3ee3059937b93c548: 2023-09-15 10:00:04,419 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ff21bd5cdaf1b0fd04568652dda7390: 2023-09-15 10:00:04,420 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,420 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,426 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:04,426 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:04,429 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:00:04,429 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:00:04,448 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:04,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 10:00:04,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:04,468 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:00:04,471 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. completed. 2023-09-15 10:00:04,471 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:04,474 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:04,474 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:04,474 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,475 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 10:00:04,475 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:00:04,479 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. completed. 2023-09-15 10:00:04,479 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:04,479 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:04,479 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:04,479 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,479 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-15 10:00:04,479 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:00:04,480 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 10:00:04,480 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,480 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:04,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:04,480 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 10:00:04,481 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 10:00:04,481 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:04,482 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:04,482 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-15 10:00:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:04,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,34885,1694771995831': 2023-09-15 10:00:04,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-15 10:00:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:04,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:00:04,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-15 10:00:04,490 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-15 10:00:04,490 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:00:04,490 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:00:04,490 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,490 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:00:04,492 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,492 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:04,493 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:04,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:04,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,493 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:04,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:04,494 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,494 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:04,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,496 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:04,497 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,497 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:04,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:04,509 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:04,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:04,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:04,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:04,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:04,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:04,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-15 10:00:04,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:04,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:00:04,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:04,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:04,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,511 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,511 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:04,511 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:04,511 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,512 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:04,512 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:04,512 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,512 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 10:00:04,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,536 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,596 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-15 10:00:04,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,597 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:04,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694772004339Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694772004534 (+195 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694772004534Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694772004534Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694772004547 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694772004583 (+36 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694772004596 (+13 ms) 2023-09-15 10:00:04,599 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 10:00:04,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 259 msec 2023-09-15 10:00:04,668 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:04,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 10:00:04,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:00:04,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46549] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:00:04,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34885] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:00:04,700 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-15 10:00:04,700 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:04,700 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:04,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 10:00:04,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772004717 (current time:1694772004717). 2023-09-15 10:00:04,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:00:04,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x25acf83c to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:04,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ccc96f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:04,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,729 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25acf83c to 127.0.0.1:62768 2023-09-15 10:00:04,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:04,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x243612a3 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:04,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66996301, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:04,739 DEBUG [hconnection-0x2e2a527c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,742 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:04,747 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:04,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x243612a3 to 127.0.0.1:62768 2023-09-15 10:00:04,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:04,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-15 10:00:04,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:00:04,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 10:00:04,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 10:00:04,755 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 10:00:04,758 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694772604758 2023-09-15 10:00:04,758 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-15 10:00:04,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-15 10:00:04,759 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:00:04,759 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:00:04,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 10:00:04,761 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-15 10:00:04,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-09-15 10:00:04,764 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 10:00:04,768 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694772604768 2023-09-15 10:00:04,843 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:04,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-15 10:00:04,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:04,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-15 10:00:04,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-15 10:00:04,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-15 10:00:04,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:04,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-15 10:00:04,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-15 10:00:04,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-15 10:00:04,860 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:04,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 10:00:04,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:04,861 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:00:05,062 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:05,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 10:00:05,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:05,063 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-15 10:00:05,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-15 10:00:05,199 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-15 10:00:05,199 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:05,199 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-15 10:00:05,199 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-15 10:00:05,200 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,200 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,201 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:05,201 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:05,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:05,201 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:05,201 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:05,201 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,202 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:05,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:05,202 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,202 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 10:00:05,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-15 10:00:05,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 10:00:05,204 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 10:00:05,204 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:05,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 10:00:05,208 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 10:00:05,209 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 10:00:05,209 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:05,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:05,209 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-15 10:00:05,210 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 10:00:05,211 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-15 10:00:05,213 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,213 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:05,213 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,213 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,213 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:05,213 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,213 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:05,214 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,214 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:05,214 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,214 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b2f5f1f[Count = 1] remaining members to acquire global barrier 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:05,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:05,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-15 10:00:05,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b2f5f1f[Count = 0] remaining members to acquire global barrier 2023-09-15 10:00:05,219 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-15 10:00:05,219 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 10:00:05,221 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:05,221 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:05,221 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. started... 2023-09-15 10:00:05,221 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,221 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 10:00:05,221 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. started... 2023-09-15 10:00:05,221 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1ff21bd5cdaf1b0fd04568652dda7390 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-15 10:00:05,221 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:00:05,221 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8e7a012ab726c6c3ee3059937b93c548 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-15 10:00:05,221 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:00:05,224 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 10:00:05,224 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:05,224 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 10:00:05,362 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309151c6b585caa0443a48f67b11018071827 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309151c6b585caa0443a48f67b11018071827 2023-09-15 10:00:05,362 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309151ed777e5922e45979aa175b4d21b4622 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309151ed777e5922e45979aa175b4d21b4622 2023-09-15 10:00:05,364 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:05,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 10:00:05,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:05,368 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-15 10:00:05,406 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/.tmp/cf/4202e90e7c78466d8f58e0dcae0c8292 2023-09-15 10:00:05,409 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/.tmp/cf/9004972995544a9e9b5c26f719fc421b 2023-09-15 10:00:05,420 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/.tmp/cf/4202e90e7c78466d8f58e0dcae0c8292 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf/4202e90e7c78466d8f58e0dcae0c8292 2023-09-15 10:00:05,423 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/.tmp/cf/9004972995544a9e9b5c26f719fc421b as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf/9004972995544a9e9b5c26f719fc421b 2023-09-15 10:00:05,430 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf/4202e90e7c78466d8f58e0dcae0c8292, entries=5, sequenceid=6, filesize=5.7 K 2023-09-15 10:00:05,432 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf/9004972995544a9e9b5c26f719fc421b, entries=45, sequenceid=6, filesize=12.5 K 2023-09-15 10:00:05,436 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 1ff21bd5cdaf1b0fd04568652dda7390 in 215ms, sequenceid=6, compaction requested=false 2023-09-15 10:00:05,436 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-15 10:00:05,437 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 8e7a012ab726c6c3ee3059937b93c548 in 216ms, sequenceid=6, compaction requested=false 2023-09-15 10:00:05,438 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e7a012ab726c6c3ee3059937b93c548: 2023-09-15 10:00:05,438 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ff21bd5cdaf1b0fd04568652dda7390: 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf/9004972995544a9e9b5c26f719fc421b] hfiles 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf/4202e90e7c78466d8f58e0dcae0c8292] hfiles 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf/9004972995544a9e9b5c26f719fc421b for snapshot=snaptb0-testExportWithTargetName 2023-09-15 10:00:05,439 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf/4202e90e7c78466d8f58e0dcae0c8292 for snapshot=snaptb0-testExportWithTargetName 2023-09-15 10:00:05,475 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. completed. 2023-09-15 10:00:05,475 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:05,476 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. completed. 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,476 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-15 10:00:05,476 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:00:05,477 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 10:00:05,477 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,478 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:05,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:05,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:05,478 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 10:00:05,479 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-15 10:00:05,480 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:05,479 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:05,480 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-15 10:00:05,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:05,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:05,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:05,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,34885,1694771995831': 2023-09-15 10:00:05,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-15 10:00:05,489 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-15 10:00:05,489 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:00:05,489 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:00:05,489 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-15 10:00:05,489 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:00:05,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:05,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:05,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,492 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:05,491 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:05,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:05,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:05,492 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,493 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:05,494 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-15 10:00:05,496 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,496 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,497 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:05,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,509 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,510 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:05,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:05,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:05,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:05,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:05,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-15 10:00:05,510 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:05,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-15 10:00:05,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-15 10:00:05,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:05,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:00:05,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:05,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:05,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:05,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309151c6b585caa0443a48f67b11018071827, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309151ed777e5922e45979aa175b4d21b4622] mob files 2023-09-15 10:00:05,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309151c6b585caa0443a48f67b11018071827 2023-09-15 10:00:05,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309151ed777e5922e45979aa175b4d21b4622 2023-09-15 10:00:05,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-15 10:00:05,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-15 10:00:05,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-15 10:00:05,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694772004758Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694772005531 (+773 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694772005531Loading Region manifests for snaptb0-testExportWithTargetName at 1694772005531Writing data manifest for snaptb0-testExportWithTargetName at 1694772005536 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694772005563 (+27 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694772005577 (+14 ms) 2023-09-15 10:00:05,580 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-15 10:00:05,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 822 msec 2023-09-15 10:00:05,868 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:05,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-15 10:00:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:00:05,872 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872 2023-09-15 10:00:05,873 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38409, tgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872, rawTgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:05,912 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:05,912 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1678985690_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-15 10:00:05,912 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-15 10:00:05,935 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-15 10:00:06,016 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,016 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,017 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,017 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,825 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-5591939085837355690.jar 2023-09-15 10:00:06,825 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,826 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,886 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-4832646386917285836.jar 2023-09-15 10:00:06,887 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,888 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,889 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,890 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,891 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,892 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:06,892 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:00:06,893 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:00:06,894 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:00:06,894 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:00:06,895 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:00:06,896 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:00:06,896 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:00:06,897 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:00:06,898 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:00:06,899 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:00:06,904 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:06,905 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:06,906 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:06,906 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:06,907 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:06,908 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:06,909 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:07,685 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:00:07,691 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-15 10:00:07,700 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-15 10:00:08,102 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:08,103 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:08,891 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0001_000001 (auth:SIMPLE) 2023-09-15 10:00:09,169 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:00:12,699 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0001_000001 (auth:SIMPLE) 2023-09-15 10:00:14,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0001_000001 (auth:SIMPLE) 2023-09-15 10:00:17,275 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0001_000001 (auth:SIMPLE) 2023-09-15 10:00:18,478 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:00:18,481 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:00:18,492 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-15 10:00:18,493 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:00:18,493 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:00:18,493 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-15 10:00:18,494 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-15 10:00:18,494 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-15 10:00:18,494 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872/.hbase-snapshot/testExportWithTargetName 2023-09-15 10:00:18,495 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-15 10:00:18,495 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772005872/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-15 10:00:18,507 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-15 10:00:18,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-09-15 10:00:18,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,526 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772018526"}]},"ts":"1694772018526"} 2023-09-15 10:00:18,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 10:00:18,528 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-15 10:00:18,530 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-15 10:00:18,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, UNASSIGN}] 2023-09-15 10:00:18,535 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, UNASSIGN 2023-09-15 10:00:18,535 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, UNASSIGN 2023-09-15 10:00:18,536 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1ff21bd5cdaf1b0fd04568652dda7390, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:18,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8e7a012ab726c6c3ee3059937b93c548, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:18,536 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772018536"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772018536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772018536"}]},"ts":"1694772018536"} 2023-09-15 10:00:18,536 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772018536"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772018536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772018536"}]},"ts":"1694772018536"} 2023-09-15 10:00:18,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 1ff21bd5cdaf1b0fd04568652dda7390, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 10:00:18,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 8e7a012ab726c6c3ee3059937b93c548, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:00:18,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 10:00:18,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:18,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8e7a012ab726c6c3ee3059937b93c548, disabling compactions & flushes 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1ff21bd5cdaf1b0fd04568652dda7390, disabling compactions & flushes 2023-09-15 10:00:18,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. after waiting 0 ms 2023-09-15 10:00:18,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. after waiting 0 ms 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:18,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:18,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:00:18,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:00:18,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:18,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:18,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548. 2023-09-15 10:00:18,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390. 2023-09-15 10:00:18,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8e7a012ab726c6c3ee3059937b93c548: 2023-09-15 10:00:18,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1ff21bd5cdaf1b0fd04568652dda7390: 2023-09-15 10:00:18,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:18,722 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1ff21bd5cdaf1b0fd04568652dda7390, regionState=CLOSED 2023-09-15 10:00:18,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:18,722 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772018721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772018721"}]},"ts":"1694772018721"} 2023-09-15 10:00:18,723 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=8e7a012ab726c6c3ee3059937b93c548, regionState=CLOSED 2023-09-15 10:00:18,723 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694772018722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772018722"}]},"ts":"1694772018722"} 2023-09-15 10:00:18,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-15 10:00:18,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 1ff21bd5cdaf1b0fd04568652dda7390, server=jenkins-hbase17.apache.org,34885,1694771995831 in 186 msec 2023-09-15 10:00:18,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-15 10:00:18,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 8e7a012ab726c6c3ee3059937b93c548, server=jenkins-hbase17.apache.org,46549,1694771995795 in 186 msec 2023-09-15 10:00:18,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1ff21bd5cdaf1b0fd04568652dda7390, UNASSIGN in 194 msec 2023-09-15 10:00:18,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-15 10:00:18,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8e7a012ab726c6c3ee3059937b93c548, UNASSIGN in 195 msec 2023-09-15 10:00:18,730 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772018730"}]},"ts":"1694772018730"} 2023-09-15 10:00:18,732 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-15 10:00:18,733 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-15 10:00:18,737 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 218 msec 2023-09-15 10:00:18,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-15 10:00:18,830 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-15 10:00:18,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-09-15 10:00:18,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,844 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-15 10:00:18,847 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,850 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-15 10:00:18,851 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 10:00:18,851 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 10:00:18,851 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 10:00:18,852 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-15 10:00:18,853 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:18,853 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:18,853 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:18,853 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 10:00:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 10:00:18,853 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:00:18,853 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:00:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 10:00:18,853 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:00:18,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-15 10:00:18,854 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:00:18,854 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:18,855 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:18,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-15 10:00:18,858 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/recovered.edits] 2023-09-15 10:00:18,858 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/recovered.edits] 2023-09-15 10:00:18,865 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf/9004972995544a9e9b5c26f719fc421b to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/cf/9004972995544a9e9b5c26f719fc421b 2023-09-15 10:00:18,865 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf/4202e90e7c78466d8f58e0dcae0c8292 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/cf/4202e90e7c78466d8f58e0dcae0c8292 2023-09-15 10:00:18,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548/recovered.edits/9.seqid 2023-09-15 10:00:18,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390/recovered.edits/9.seqid 2023-09-15 10:00:18,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/8e7a012ab726c6c3ee3059937b93c548 2023-09-15 10:00:18,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportWithTargetName/1ff21bd5cdaf1b0fd04568652dda7390 2023-09-15 10:00:18,869 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-15 10:00:18,870 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-15 10:00:18,871 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-15 10:00:18,876 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309151c6b585caa0443a48f67b11018071827 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309151c6b585caa0443a48f67b11018071827 2023-09-15 10:00:18,878 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309151ed777e5922e45979aa175b4d21b4622 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309151ed777e5922e45979aa175b4d21b4622 2023-09-15 10:00:18,878 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-15 10:00:18,882 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,901 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-15 10:00:18,904 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-15 10:00:18,906 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,906 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-15 10:00:18,906 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772018906"}]},"ts":"9223372036854775807"} 2023-09-15 10:00:18,906 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772018906"}]},"ts":"9223372036854775807"} 2023-09-15 10:00:18,912 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 10:00:18,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8e7a012ab726c6c3ee3059937b93c548, NAME => 'testtb-testExportWithTargetName,,1694772003069.8e7a012ab726c6c3ee3059937b93c548.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1ff21bd5cdaf1b0fd04568652dda7390, NAME => 'testtb-testExportWithTargetName,1,1694772003069.1ff21bd5cdaf1b0fd04568652dda7390.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 10:00:18,912 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-15 10:00:18,913 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772018912"}]},"ts":"9223372036854775807"} 2023-09-15 10:00:18,915 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-15 10:00:18,917 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-15 10:00:18,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-09-15 10:00:18,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-15 10:00:18,960 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-15 10:00:18,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-15 10:00:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-15 10:00:18,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-09-15 10:00:18,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-15 10:00:19,013 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 705) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:32893 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1633178238_1 at /127.0.0.1:48962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:48146 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:56806 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:36919 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:36549 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:48986 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1633178238_1 at /127.0.0.1:48122 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 141) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=9757 (was 10429) 2023-09-15 10:00:19,013 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-15 10:00:19,029 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=168, AvailableMemoryMB=9756 2023-09-15 10:00:19,030 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-15 10:00:19,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 10:00:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:19,037 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:00:19,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-15 10:00:19,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 10:00:19,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:00:19,043 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,043 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,044 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 empty. 2023-09-15 10:00:19,044 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 empty. 2023-09-15 10:00:19,045 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,045 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,045 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-15 10:00:19,056 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-15 10:00:19,057 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 04b2578953affd01efb248aa8fba8a23, NAME => 'testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:00:19,057 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => adddb06469282fefdd2e2a7c3cc2e646, NAME => 'testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:00:19,073 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:19,074 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing adddb06469282fefdd2e2a7c3cc2e646, disabling compactions & flushes 2023-09-15 10:00:19,074 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,074 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,074 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. after waiting 0 ms 2023-09-15 10:00:19,074 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,074 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,074 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for adddb06469282fefdd2e2a7c3cc2e646: 2023-09-15 10:00:19,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:19,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 04b2578953affd01efb248aa8fba8a23, disabling compactions & flushes 2023-09-15 10:00:19,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. after waiting 0 ms 2023-09-15 10:00:19,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 04b2578953affd01efb248aa8fba8a23: 2023-09-15 10:00:19,085 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:00:19,086 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772019086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772019086"}]},"ts":"1694772019086"} 2023-09-15 10:00:19,086 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772019086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772019086"}]},"ts":"1694772019086"} 2023-09-15 10:00:19,089 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:00:19,090 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:00:19,091 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772019090"}]},"ts":"1694772019090"} 2023-09-15 10:00:19,092 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-15 10:00:19,095 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:00:19,096 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:00:19,096 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:00:19,096 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:00:19,096 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:00:19,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, ASSIGN}] 2023-09-15 10:00:19,099 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, ASSIGN 2023-09-15 10:00:19,099 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, ASSIGN 2023-09-15 10:00:19,100 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35307,1694771995748; forceNewPlan=false, retain=false 2023-09-15 10:00:19,100 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:00:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 10:00:19,251 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:00:19,253 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=04b2578953affd01efb248aa8fba8a23, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=adddb06469282fefdd2e2a7c3cc2e646, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,253 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772019253"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772019253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772019253"}]},"ts":"1694772019253"} 2023-09-15 10:00:19,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772019253"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772019253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772019253"}]},"ts":"1694772019253"} 2023-09-15 10:00:19,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure adddb06469282fefdd2e2a7c3cc2e646, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:00:19,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 04b2578953affd01efb248aa8fba8a23, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:00:19,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 10:00:19,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04b2578953affd01efb248aa8fba8a23, NAME => 'testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 10:00:19,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. service=AccessControlService 2023-09-15 10:00:19,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:00:19,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:19,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adddb06469282fefdd2e2a7c3cc2e646, NAME => 'testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 10:00:19,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. service=AccessControlService 2023-09-15 10:00:19,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:00:19,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:19,419 INFO [StoreOpener-04b2578953affd01efb248aa8fba8a23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,420 DEBUG [StoreOpener-04b2578953affd01efb248aa8fba8a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf 2023-09-15 10:00:19,420 INFO [StoreOpener-adddb06469282fefdd2e2a7c3cc2e646-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,420 DEBUG [StoreOpener-04b2578953affd01efb248aa8fba8a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf 2023-09-15 10:00:19,421 INFO [StoreOpener-04b2578953affd01efb248aa8fba8a23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04b2578953affd01efb248aa8fba8a23 columnFamilyName cf 2023-09-15 10:00:19,422 DEBUG [StoreOpener-adddb06469282fefdd2e2a7c3cc2e646-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf 2023-09-15 10:00:19,422 DEBUG [StoreOpener-adddb06469282fefdd2e2a7c3cc2e646-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf 2023-09-15 10:00:19,422 INFO [StoreOpener-adddb06469282fefdd2e2a7c3cc2e646-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adddb06469282fefdd2e2a7c3cc2e646 columnFamilyName cf 2023-09-15 10:00:19,422 INFO [StoreOpener-04b2578953affd01efb248aa8fba8a23-1] regionserver.HStore(310): Store=04b2578953affd01efb248aa8fba8a23/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:00:19,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,426 INFO [StoreOpener-adddb06469282fefdd2e2a7c3cc2e646-1] regionserver.HStore(310): Store=adddb06469282fefdd2e2a7c3cc2e646/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:00:19,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:19,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:19,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:00:19,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 04b2578953affd01efb248aa8fba8a23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69337482, jitterRate=0.033208996057510376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:00:19,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 04b2578953affd01efb248aa8fba8a23: 2023-09-15 10:00:19,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:00:19,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened adddb06469282fefdd2e2a7c3cc2e646; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64044520, jitterRate=-0.0456622838973999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:00:19,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for adddb06469282fefdd2e2a7c3cc2e646: 2023-09-15 10:00:19,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23., pid=31, masterSystemTime=1694772019410 2023-09-15 10:00:19,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646., pid=30, masterSystemTime=1694772019408 2023-09-15 10:00:19,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,436 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=04b2578953affd01efb248aa8fba8a23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,436 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772019436"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772019436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772019436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772019436"}]},"ts":"1694772019436"} 2023-09-15 10:00:19,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,437 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=adddb06469282fefdd2e2a7c3cc2e646, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772019437"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772019437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772019437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772019437"}]},"ts":"1694772019437"} 2023-09-15 10:00:19,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-15 10:00:19,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-15 10:00:19,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 04b2578953affd01efb248aa8fba8a23, server=jenkins-hbase17.apache.org,46549,1694771995795 in 184 msec 2023-09-15 10:00:19,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure adddb06469282fefdd2e2a7c3cc2e646, server=jenkins-hbase17.apache.org,35307,1694771995748 in 186 msec 2023-09-15 10:00:19,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, ASSIGN in 351 msec 2023-09-15 10:00:19,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-15 10:00:19,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, ASSIGN in 351 msec 2023-09-15 10:00:19,453 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:00:19,453 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772019453"}]},"ts":"1694772019453"} 2023-09-15 10:00:19,455 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-15 10:00:19,457 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:00:19,458 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-15 10:00:19,460 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 10:00:19,461 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:19,461 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:19,461 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:19,461 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:19,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:19,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:19,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:19,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:19,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 429 msec 2023-09-15 10:00:19,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-15 10:00:19,645 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-15 10:00:19,648 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-15 10:00:19,648 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,650 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:19,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:00:19,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772019669 (current time:1694772019669). 2023-09-15 10:00:19,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:00:19,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x2c94b319 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:19,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f8ab136, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:19,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:19,684 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:19,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c94b319 to 127.0.0.1:62768 2023-09-15 10:00:19,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:19,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x26f6dda0 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:19,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f73be1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:19,696 DEBUG [hconnection-0x257ab9c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:19,699 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:19,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:19,708 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26f6dda0 to 127.0.0.1:62768 2023-09-15 10:00:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 10:00:19,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:00:19,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:00:19,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:00:19,714 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:00:19,716 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694772619716 2023-09-15 10:00:19,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-15 10:00:19,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:00:19,717 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:00:19,718 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:00:19,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 10:00:19,719 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:00:19,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-15 10:00:19,722 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 10:00:19,723 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694772619723 2023-09-15 10:00:19,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,737 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-15 10:00:19,737 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:19,738 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-15 10:00:19,738 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-15 10:00:19,739 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,739 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,739 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:19,739 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:19,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:19,740 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,739 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:19,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:19,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:19,740 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,740 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,740 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,740 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,741 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:19,741 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 10:00:19,742 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:19,741 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 10:00:19,743 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 10:00:19,743 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 10:00:19,742 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 10:00:19,743 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 10:00:19,743 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 10:00:19,743 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 10:00:19,743 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:19,744 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 10:00:19,744 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-15 10:00:19,744 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,747 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:19,747 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:19,747 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,748 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:19,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:19,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:19,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:19,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-15 10:00:19,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ebba1c9[Count = 1] remaining members to acquire global barrier 2023-09-15 10:00:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:19,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:19,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-15 10:00:19,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ebba1c9[Count = 0] remaining members to acquire global barrier 2023-09-15 10:00:19,752 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 10:00:19,752 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,752 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,752 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 10:00:19,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:00:19,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,753 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,753 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:19,753 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:19,753 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. started... 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:19,753 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:19,753 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,754 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04b2578953affd01efb248aa8fba8a23: 2023-09-15 10:00:19,754 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. started... 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adddb06469282fefdd2e2a7c3cc2e646: 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:00:19,755 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 10:00:19,755 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:00:19,755 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:19,755 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 10:00:19,776 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. completed. 2023-09-15 10:00:19,777 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:00:19,777 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. completed. 2023-09-15 10:00:19,777 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:19,777 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,778 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-15 10:00:19,778 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:00:19,778 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 10:00:19,778 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,778 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:19,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:19,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:19,778 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 10:00:19,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,780 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 10:00:19,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:19,780 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:19,780 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-15 10:00:19,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:19,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:19,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:19,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:19,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:19,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:19,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:00:19,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 10:00:19,789 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-15 10:00:19,789 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:00:19,789 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:00:19,789 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,789 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:19,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:19,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:19,791 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,791 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:19,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,794 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:19,794 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,794 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:19,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:19,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:19,797 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:19,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:19,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:19,797 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,799 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,799 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:19,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:19,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:19,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:19,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:19,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-15 10:00:19,799 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:19,800 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,800 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:19,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:00:19,800 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:19,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:19,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:19,800 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,800 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 10:00:19,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,818 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:00:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:19,819 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:00:19,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,843 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-15 10:00:19,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,844 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:19,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694772019716Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694772019813 (+97 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694772019813Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694772019813Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694772019818 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694772019834 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694772019843 (+9 ms) 2023-09-15 10:00:19,846 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 10:00:19,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 130 msec 2023-09-15 10:00:20,019 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:20,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:00:20,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:00:20,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46549] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:00:20,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35307] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:00:20,035 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-15 10:00:20,035 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:20,035 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:20,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:00:20,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772020050 (current time:1694772020050). 2023-09-15 10:00:20,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:00:20,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x2ff1877d to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:20,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f79a2ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:20,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:20,064 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:20,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ff1877d to 127.0.0.1:62768 2023-09-15 10:00:20,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:20,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x13f35da8 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:20,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521771ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:20,075 DEBUG [hconnection-0x6007fa87-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:20,076 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:20,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:20,083 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:20,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13f35da8 to 127.0.0.1:62768 2023-09-15 10:00:20,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:20,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 10:00:20,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:00:20,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:00:20,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:00:20,089 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:00:20,090 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694772620090 2023-09-15 10:00:20,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-15 10:00:20,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:00:20,092 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:00:20,092 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:00:20,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 10:00:20,093 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:00:20,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-15 10:00:20,096 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 10:00:20,097 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694772620097 2023-09-15 10:00:20,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-15 10:00:20,108 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-15 10:00:20,108 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:20,109 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-15 10:00:20,109 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-15 10:00:20,110 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,110 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,110 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:20,110 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:20,111 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:20,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:20,111 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:20,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:20,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:20,111 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,111 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,111 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,111 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:00:20,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 10:00:20,112 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-15 10:00:20,112 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 10:00:20,112 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-15 10:00:20,113 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:20,113 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 10:00:20,118 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-15 10:00:20,119 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,119 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:20,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,120 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:20,120 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:20,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f8f6bd[Count = 1] remaining members to acquire global barrier 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:20,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:20,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-15 10:00:20,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32f8f6bd[Count = 0] remaining members to acquire global barrier 2023-09-15 10:00:20,124 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 10:00:20,124 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,124 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,124 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,124 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:00:20,125 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:20,125 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 10:00:20,125 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. started... 2023-09-15 10:00:20,125 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:20,125 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,125 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. started... 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:20,125 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:00:20,125 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04b2578953affd01efb248aa8fba8a23 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:00:20,125 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2745): Flushing adddb06469282fefdd2e2a7c3cc2e646 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-15 10:00:20,125 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:20,127 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 10:00:20,127 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:20,127 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 10:00:20,162 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309155dcbf61689e24f0086a209a8cedc8cf9 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309155dcbf61689e24f0086a209a8cedc8cf9 2023-09-15 10:00:20,162 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309158bfed0a76dc44b1fbc45d29f48eeae92 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309158bfed0a76dc44b1fbc45d29f48eeae92 2023-09-15 10:00:20,194 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:20,195 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/.tmp/cf/196d5140984d489686aac35842afe8ed 2023-09-15 10:00:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:00:20,195 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/.tmp/cf/ef04cbfe89e44ad7a764f3274689e8fd 2023-09-15 10:00:20,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:20,196 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:00:20,202 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/.tmp/cf/ef04cbfe89e44ad7a764f3274689e8fd as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf/ef04cbfe89e44ad7a764f3274689e8fd 2023-09-15 10:00:20,204 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/.tmp/cf/196d5140984d489686aac35842afe8ed as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf/196d5140984d489686aac35842afe8ed 2023-09-15 10:00:20,209 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf/196d5140984d489686aac35842afe8ed, entries=46, sequenceid=6, filesize=12.7 K 2023-09-15 10:00:20,209 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf/ef04cbfe89e44ad7a764f3274689e8fd, entries=4, sequenceid=6, filesize=5.6 K 2023-09-15 10:00:20,210 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 04b2578953affd01efb248aa8fba8a23 in 85ms, sequenceid=6, compaction requested=false 2023-09-15 10:00:20,210 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for adddb06469282fefdd2e2a7c3cc2e646 in 85ms, sequenceid=6, compaction requested=false 2023-09-15 10:00:20,210 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-15 10:00:20,210 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-15 10:00:20,213 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04b2578953affd01efb248aa8fba8a23: 2023-09-15 10:00:20,213 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for adddb06469282fefdd2e2a7c3cc2e646: 2023-09-15 10:00:20,213 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 10:00:20,213 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 10:00:20,214 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:20,214 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:20,214 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf/196d5140984d489686aac35842afe8ed] hfiles 2023-09-15 10:00:20,214 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf/ef04cbfe89e44ad7a764f3274689e8fd] hfiles 2023-09-15 10:00:20,214 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf/196d5140984d489686aac35842afe8ed for snapshot=snaptb0-testExportFileSystemState 2023-09-15 10:00:20,214 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf/ef04cbfe89e44ad7a764f3274689e8fd for snapshot=snaptb0-testExportFileSystemState 2023-09-15 10:00:20,227 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. completed. 2023-09-15 10:00:20,227 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:20,227 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:20,227 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:20,227 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,227 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 10:00:20,227 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:00:20,229 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 10:00:20,229 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,229 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:20,229 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 10:00:20,231 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. completed. 2023-09-15 10:00:20,231 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:20,231 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:20,231 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:20,231 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,231 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-15 10:00:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:20,231 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:00:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,232 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,232 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-15 10:00:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,232 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:20,232 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-15 10:00:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:00:20,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 10:00:20,239 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-15 10:00:20,239 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:00:20,239 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:00:20,239 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-15 10:00:20,239 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:00:20,240 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,240 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,240 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,240 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:20,240 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:20,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,240 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:20,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,241 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:20,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:20,241 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:20,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,242 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,242 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:20,244 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-15 10:00:20,244 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,244 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:20,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:20,246 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:20,247 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,247 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:20,247 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:20,247 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:20,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-15 10:00:20,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:20,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:20,247 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:20,247 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:20,248 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:20,248 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:20,248 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:20,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:20,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:20,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:20,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-15 10:00:20,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:20,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:20,248 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,249 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-15 10:00:20,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:00:20,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:20,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:20,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309158bfed0a76dc44b1fbc45d29f48eeae92, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309155dcbf61689e24f0086a209a8cedc8cf9] mob files 2023-09-15 10:00:20,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309158bfed0a76dc44b1fbc45d29f48eeae92 2023-09-15 10:00:20,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309155dcbf61689e24f0086a209a8cedc8cf9 2023-09-15 10:00:20,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-15 10:00:20,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-15 10:00:20,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,287 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694772020090Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694772020259 (+169 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694772020259Loading Region manifests for snaptb0-testExportFileSystemState at 1694772020259Writing data manifest for snaptb0-testExportFileSystemState at 1694772020262 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694772020278 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694772020286 (+8 ms) 2023-09-15 10:00:20,290 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-15 10:00:20,292 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 199 msec 2023-09-15 10:00:20,396 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:20,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:00:20,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:00:20,398 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398 2023-09-15 10:00:20,398 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38409, tgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398, rawTgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:20,425 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:20,425 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1900012689_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,425 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-15 10:00:20,439 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-15 10:00:20,475 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:20,475 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:20,476 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:20,476 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,250 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-7539633649079607108.jar 2023-09-15 10:00:21,250 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,251 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,314 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-40399850743288699.jar 2023-09-15 10:00:21,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,316 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,316 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,316 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:21,317 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:00:21,317 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:00:21,317 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:00:21,318 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:00:21,318 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:00:21,318 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:00:21,319 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:00:21,319 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:00:21,319 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:00:21,320 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:00:21,320 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:21,320 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:21,321 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:21,321 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:21,321 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:21,322 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:21,322 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:21,848 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:00:21,851 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-15 10:00:21,854 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-15 10:00:23,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:23,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:23,474 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0001_000001 (auth:SIMPLE) 2023-09-15 10:00:23,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0002_000001 (auth:SIMPLE) 2023-09-15 10:00:24,306 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:00:27,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0002_000001 (auth:SIMPLE) 2023-09-15 10:00:29,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0002_000001 (auth:SIMPLE) 2023-09-15 10:00:31,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0002_000001 (auth:SIMPLE) 2023-09-15 10:00:31,962 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694772001969_0002_01_000002 is : 143 2023-09-15 10:00:33,070 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:00:33,071 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:00:33,079 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-15 10:00:33,079 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:00:33,080 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:00:33,080 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 10:00:33,080 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-15 10:00:33,080 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-15 10:00:33,080 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-15 10:00:33,081 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-15 10:00:33,081 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772020398/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-15 10:00:33,088 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-15 10:00:33,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-09-15 10:00:33,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 10:00:33,094 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772033094"}]},"ts":"1694772033094"} 2023-09-15 10:00:33,096 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-15 10:00:33,097 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-15 10:00:33,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, UNASSIGN}] 2023-09-15 10:00:33,101 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, UNASSIGN 2023-09-15 10:00:33,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, UNASSIGN 2023-09-15 10:00:33,102 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=adddb06469282fefdd2e2a7c3cc2e646, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:33,102 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=04b2578953affd01efb248aa8fba8a23, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:33,102 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772033102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772033102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772033102"}]},"ts":"1694772033102"} 2023-09-15 10:00:33,102 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772033102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772033102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772033102"}]},"ts":"1694772033102"} 2023-09-15 10:00:33,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 04b2578953affd01efb248aa8fba8a23, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:00:33,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure adddb06469282fefdd2e2a7c3cc2e646, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:00:33,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 10:00:33,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:33,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 04b2578953affd01efb248aa8fba8a23, disabling compactions & flushes 2023-09-15 10:00:33,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:33,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:33,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. after waiting 0 ms 2023-09-15 10:00:33,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:33,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:33,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing adddb06469282fefdd2e2a7c3cc2e646, disabling compactions & flushes 2023-09-15 10:00:33,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:33,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:33,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. after waiting 0 ms 2023-09-15 10:00:33,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:33,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:00:33,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:00:33,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:33,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:00:33,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23. 2023-09-15 10:00:33,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646. 2023-09-15 10:00:33,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 04b2578953affd01efb248aa8fba8a23: 2023-09-15 10:00:33,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for adddb06469282fefdd2e2a7c3cc2e646: 2023-09-15 10:00:33,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:33,276 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=adddb06469282fefdd2e2a7c3cc2e646, regionState=CLOSED 2023-09-15 10:00:33,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:33,276 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772033275"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772033275"}]},"ts":"1694772033275"} 2023-09-15 10:00:33,276 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=04b2578953affd01efb248aa8fba8a23, regionState=CLOSED 2023-09-15 10:00:33,276 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694772033276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772033276"}]},"ts":"1694772033276"} 2023-09-15 10:00:33,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-15 10:00:33,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure adddb06469282fefdd2e2a7c3cc2e646, server=jenkins-hbase17.apache.org,35307,1694771995748 in 172 msec 2023-09-15 10:00:33,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-15 10:00:33,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 04b2578953affd01efb248aa8fba8a23, server=jenkins-hbase17.apache.org,46549,1694771995795 in 176 msec 2023-09-15 10:00:33,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=adddb06469282fefdd2e2a7c3cc2e646, UNASSIGN in 183 msec 2023-09-15 10:00:33,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-15 10:00:33,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=04b2578953affd01efb248aa8fba8a23, UNASSIGN in 184 msec 2023-09-15 10:00:33,286 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772033286"}]},"ts":"1694772033286"} 2023-09-15 10:00:33,288 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-15 10:00:33,289 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-15 10:00:33,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 201 msec 2023-09-15 10:00:33,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-15 10:00:33,399 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-15 10:00:33,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-09-15 10:00:33,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,407 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-15 10:00:33,408 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,410 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-15 10:00:33,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 10:00:33,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 10:00:33,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 10:00:33,411 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 10:00:33,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 10:00:33,412 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-15 10:00:33,413 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,413 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 10:00:33,413 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-15 10:00:33,413 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-15 10:00:33,413 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:00:33,413 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,413 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,413 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-09-15 10:00:33,413 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:00:33,414 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:33,414 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:33,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-15 10:00:33,415 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/recovered.edits] 2023-09-15 10:00:33,415 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/recovered.edits] 2023-09-15 10:00:33,419 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf/196d5140984d489686aac35842afe8ed to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/cf/196d5140984d489686aac35842afe8ed 2023-09-15 10:00:33,419 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf/ef04cbfe89e44ad7a764f3274689e8fd to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/cf/ef04cbfe89e44ad7a764f3274689e8fd 2023-09-15 10:00:33,422 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646/recovered.edits/9.seqid 2023-09-15 10:00:33,422 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23/recovered.edits/9.seqid 2023-09-15 10:00:33,423 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/adddb06469282fefdd2e2a7c3cc2e646 2023-09-15 10:00:33,423 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemState/04b2578953affd01efb248aa8fba8a23 2023-09-15 10:00:33,423 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-15 10:00:33,423 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-15 10:00:33,424 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-15 10:00:33,427 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309158bfed0a76dc44b1fbc45d29f48eeae92 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202309158bfed0a76dc44b1fbc45d29f48eeae92 2023-09-15 10:00:33,428 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309155dcbf61689e24f0086a209a8cedc8cf9 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309155dcbf61689e24f0086a209a8cedc8cf9 2023-09-15 10:00:33,428 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-15 10:00:33,431 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,433 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-15 10:00:33,435 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-15 10:00:33,436 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,436 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-15 10:00:33,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772033436"}]},"ts":"9223372036854775807"} 2023-09-15 10:00:33,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772033436"}]},"ts":"9223372036854775807"} 2023-09-15 10:00:33,439 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 10:00:33,439 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04b2578953affd01efb248aa8fba8a23, NAME => 'testtb-testExportFileSystemState,,1694772019031.04b2578953affd01efb248aa8fba8a23.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => adddb06469282fefdd2e2a7c3cc2e646, NAME => 'testtb-testExportFileSystemState,1,1694772019031.adddb06469282fefdd2e2a7c3cc2e646.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 10:00:33,439 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-15 10:00:33,439 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772033439"}]},"ts":"9223372036854775807"} 2023-09-15 10:00:33,441 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-15 10:00:33,442 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-15 10:00:33,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-09-15 10:00:33,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-15 10:00:33,517 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-15 10:00:33,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-15 10:00:33,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-15 10:00:33,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-09-15 10:00:33,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-15 10:00:33,563 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 754) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:42523 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:54344 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:41939 from appattempt_1694772001969_0002_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:35296 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:42055 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1208099654_1 at /127.0.0.1:54320 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=250 (was 208) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=9616 (was 9756) 2023-09-15 10:00:33,563 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-15 10:00:33,582 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=250, ProcessCount=168, AvailableMemoryMB=9616 2023-09-15 10:00:33,582 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-15 10:00:33,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 10:00:33,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:00:33,589 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:00:33,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-15 10:00:33,590 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:00:33,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 10:00:33,593 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,593 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,593 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a empty. 2023-09-15 10:00:33,594 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 empty. 2023-09-15 10:00:33,594 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,594 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,594 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-15 10:00:33,606 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-15 10:00:33,608 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a59a4a6058a2cac56becff7f4ab5703a, NAME => 'testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:00:33,608 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => dbd8762205b2c2c0970dd283f0c093d7, NAME => 'testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:00:33,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:33,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing dbd8762205b2c2c0970dd283f0c093d7, disabling compactions & flushes 2023-09-15 10:00:33,622 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,622 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. after waiting 0 ms 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,623 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for dbd8762205b2c2c0970dd283f0c093d7: 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a59a4a6058a2cac56becff7f4ab5703a, disabling compactions & flushes 2023-09-15 10:00:33,623 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. after waiting 0 ms 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,623 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,623 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a59a4a6058a2cac56becff7f4ab5703a: 2023-09-15 10:00:33,626 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:00:33,627 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772033627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772033627"}]},"ts":"1694772033627"} 2023-09-15 10:00:33,627 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772033627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772033627"}]},"ts":"1694772033627"} 2023-09-15 10:00:33,633 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:00:33,634 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:00:33,634 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772033634"}]},"ts":"1694772033634"} 2023-09-15 10:00:33,636 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-15 10:00:33,638 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:00:33,640 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:00:33,640 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:00:33,640 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:00:33,640 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:00:33,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, ASSIGN}] 2023-09-15 10:00:33,643 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, ASSIGN 2023-09-15 10:00:33,643 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, ASSIGN 2023-09-15 10:00:33,644 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34885,1694771995831; forceNewPlan=false, retain=false 2023-09-15 10:00:33,644 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35307,1694771995748; forceNewPlan=false, retain=false 2023-09-15 10:00:33,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 10:00:33,795 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:00:33,797 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dbd8762205b2c2c0970dd283f0c093d7, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:33,797 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a59a4a6058a2cac56becff7f4ab5703a, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:33,797 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772033797"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772033797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772033797"}]},"ts":"1694772033797"} 2023-09-15 10:00:33,797 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772033797"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772033797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772033797"}]},"ts":"1694772033797"} 2023-09-15 10:00:33,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure a59a4a6058a2cac56becff7f4ab5703a, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:00:33,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure dbd8762205b2c2c0970dd283f0c093d7, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 10:00:33,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 10:00:33,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a59a4a6058a2cac56becff7f4ab5703a, NAME => 'testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 10:00:33,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbd8762205b2c2c0970dd283f0c093d7, NAME => 'testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 10:00:33,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. service=AccessControlService 2023-09-15 10:00:33,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. service=AccessControlService 2023-09-15 10:00:33,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:00:33,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,959 INFO [StoreOpener-dbd8762205b2c2c0970dd283f0c093d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,959 INFO [StoreOpener-a59a4a6058a2cac56becff7f4ab5703a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,961 DEBUG [StoreOpener-dbd8762205b2c2c0970dd283f0c093d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf 2023-09-15 10:00:33,961 DEBUG [StoreOpener-a59a4a6058a2cac56becff7f4ab5703a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf 2023-09-15 10:00:33,961 DEBUG [StoreOpener-dbd8762205b2c2c0970dd283f0c093d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf 2023-09-15 10:00:33,961 DEBUG [StoreOpener-a59a4a6058a2cac56becff7f4ab5703a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf 2023-09-15 10:00:33,962 INFO [StoreOpener-dbd8762205b2c2c0970dd283f0c093d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbd8762205b2c2c0970dd283f0c093d7 columnFamilyName cf 2023-09-15 10:00:33,962 INFO [StoreOpener-a59a4a6058a2cac56becff7f4ab5703a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a59a4a6058a2cac56becff7f4ab5703a columnFamilyName cf 2023-09-15 10:00:33,963 INFO [StoreOpener-dbd8762205b2c2c0970dd283f0c093d7-1] regionserver.HStore(310): Store=dbd8762205b2c2c0970dd283f0c093d7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:00:33,963 INFO [StoreOpener-a59a4a6058a2cac56becff7f4ab5703a-1] regionserver.HStore(310): Store=a59a4a6058a2cac56becff7f4ab5703a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:00:33,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:00:33,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:00:33,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:00:33,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:00:33,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened dbd8762205b2c2c0970dd283f0c093d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72301338, jitterRate=0.07737389206886292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:00:33,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for dbd8762205b2c2c0970dd283f0c093d7: 2023-09-15 10:00:33,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a59a4a6058a2cac56becff7f4ab5703a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61499709, jitterRate=-0.08358292281627655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:00:33,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a59a4a6058a2cac56becff7f4ab5703a: 2023-09-15 10:00:33,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7., pid=46, masterSystemTime=1694772033952 2023-09-15 10:00:33,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a., pid=45, masterSystemTime=1694772033952 2023-09-15 10:00:33,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:33,974 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dbd8762205b2c2c0970dd283f0c093d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:33,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772033973"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772033973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772033973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772033973"}]},"ts":"1694772033973"} 2023-09-15 10:00:33,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:33,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a59a4a6058a2cac56becff7f4ab5703a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:33,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772033974"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772033974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772033974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772033974"}]},"ts":"1694772033974"} 2023-09-15 10:00:33,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-15 10:00:33,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure dbd8762205b2c2c0970dd283f0c093d7, server=jenkins-hbase17.apache.org,34885,1694771995831 in 175 msec 2023-09-15 10:00:33,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-15 10:00:33,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure a59a4a6058a2cac56becff7f4ab5703a, server=jenkins-hbase17.apache.org,35307,1694771995748 in 177 msec 2023-09-15 10:00:33,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, ASSIGN in 337 msec 2023-09-15 10:00:33,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-15 10:00:33,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, ASSIGN in 339 msec 2023-09-15 10:00:33,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:00:33,981 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772033981"}]},"ts":"1694772033981"} 2023-09-15 10:00:33,983 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-15 10:00:33,984 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:00:33,985 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-15 10:00:33,987 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 10:00:33,988 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,988 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,988 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,988 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:00:33,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:33,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:33,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:33,990 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-15 10:00:33,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 404 msec 2023-09-15 10:00:34,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-15 10:00:34,197 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-15 10:00:34,203 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-15 10:00:34,203 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:34,207 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:34,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 10:00:34,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772034228 (current time:1694772034228). 2023-09-15 10:00:34,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:00:34,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x47038690 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:34,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8a66bca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:34,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:34,243 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:34,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47038690 to 127.0.0.1:62768 2023-09-15 10:00:34,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:34,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x70bd8144 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:34,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b51bec5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:34,256 DEBUG [hconnection-0x1012685e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:34,259 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:34,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:34,264 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:34,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70bd8144 to 127.0.0.1:62768 2023-09-15 10:00:34,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:34,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 10:00:34,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:00:34,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 10:00:34,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 10:00:34,269 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 10:00:34,270 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694772634270 2023-09-15 10:00:34,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 10:00:34,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-15 10:00:34,272 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:00:34,272 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:00:34,275 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 10:00:34,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 10:00:34,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-15 10:00:34,278 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 10:00:34,279 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694772634279 2023-09-15 10:00:34,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,292 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-15 10:00:34,292 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,293 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-15 10:00:34,293 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-15 10:00:34,294 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,294 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,295 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,295 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,295 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,296 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,296 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 10:00:34,296 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 10:00:34,296 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,296 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 10:00:34,298 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 10:00:34,298 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 10:00:34,296 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,298 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 10:00:34,299 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,299 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,299 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,299 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-15 10:00:34,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@435e805a[Count = 1] remaining members to acquire global barrier 2023-09-15 10:00:34,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,302 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 10:00:34,302 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 10:00:34,302 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 10:00:34,302 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,302 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 10:00:34,305 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 10:00:34,305 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-15 10:00:34,305 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-15 10:00:34,306 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,306 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,306 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,306 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,306 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,306 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:34,306 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-15 10:00:34,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@435e805a[Count = 0] remaining members to acquire global barrier 2023-09-15 10:00:34,308 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-15 10:00:34,308 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 10:00:34,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 10:00:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:34,311 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 10:00:34,311 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. started... 2023-09-15 10:00:34,311 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,311 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:00:34,311 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:00:34,312 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:34,312 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:34,312 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:34,313 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. started... 2023-09-15 10:00:34,313 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbd8762205b2c2c0970dd283f0c093d7: 2023-09-15 10:00:34,313 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a59a4a6058a2cac56becff7f4ab5703a: 2023-09-15 10:00:34,313 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,313 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,313 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:34,315 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:34,315 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:00:34,315 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:00:34,315 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 10:00:34,315 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,315 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 10:00:34,323 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. completed. 2023-09-15 10:00:34,323 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:34,323 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:34,323 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:34,323 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,323 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 10:00:34,323 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:00:34,324 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. completed. 2023-09-15 10:00:34,324 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:34,324 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:34,324 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:34,324 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,324 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-15 10:00:34,324 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:00:34,325 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 10:00:34,325 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,325 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,325 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 10:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,326 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,326 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 10:00:34,326 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,327 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-15 10:00:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,34885,1694771995831': 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:00:34,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-15 10:00:34,335 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-15 10:00:34,335 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:00:34,335 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:00:34,335 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,335 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,336 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,337 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,338 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,339 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,341 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,341 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,342 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,344 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,344 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,344 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,344 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,344 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,345 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,345 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-15 10:00:34,347 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,349 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:00:34,349 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,349 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,349 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 10:00:34,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,372 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:34,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 10:00:34,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:34,373 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:00:34,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-15 10:00:34,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,386 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-15 10:00:34,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694772034270Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694772034359 (+89 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694772034359Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694772034360 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694772034364 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694772034378 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694772034386 (+8 ms) 2023-09-15 10:00:34,389 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 10:00:34,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 117 msec 2023-09-15 10:00:34,574 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:34,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 10:00:34,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:00:34,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35307] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:00:34,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34885] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:00:34,590 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-15 10:00:34,590 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:34,590 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:00:34,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 10:00:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772034601 (current time:1694772034601). 2023-09-15 10:00:34,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:00:34,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x1ffda268 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:34,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@656dd1b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:34,616 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:34,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ffda268 to 127.0.0.1:62768 2023-09-15 10:00:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:34,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x7847f89d to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:00:34,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@adbeb1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:00:34,633 DEBUG [hconnection-0x1b07b93-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:34,636 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:34,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:00:34,644 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:00:34,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7847f89d to 127.0.0.1:62768 2023-09-15 10:00:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:00:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-15 10:00:34,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:00:34,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 10:00:34,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 10:00:34,650 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 10:00:34,650 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694772634650 2023-09-15 10:00:34,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-15 10:00:34,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-15 10:00:34,652 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:00:34,652 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:00:34,654 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-15 10:00:34,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 10:00:34,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-15 10:00:34,656 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 10:00:34,657 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694772634657 2023-09-15 10:00:34,665 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-15 10:00:34,665 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-15 10:00:34,665 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,667 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-15 10:00:34,667 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-15 10:00:34,667 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,667 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,668 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,668 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,668 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,668 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,668 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,669 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,669 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,669 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:00:34,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 10:00:34,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-15 10:00:34,670 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 10:00:34,670 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 10:00:34,670 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,670 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-15 10:00:34,671 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 10:00:34,671 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 10:00:34,671 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,670 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:00:34,672 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 10:00:34,673 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 10:00:34,671 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 10:00:34,673 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 10:00:34,673 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-15 10:00:34,673 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-15 10:00:34,673 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-15 10:00:34,674 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,674 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,674 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,675 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,675 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:00:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51712490[Count = 1] remaining members to acquire global barrier 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-15 10:00:34,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51712490[Count = 0] remaining members to acquire global barrier 2023-09-15 10:00:34,679 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-15 10:00:34,679 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 10:00:34,680 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-15 10:00:34,680 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:34,680 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:34,681 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:00:34,681 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:34,680 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,681 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:00:34,681 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. started... 2023-09-15 10:00:34,681 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:00:34,681 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. started... 2023-09-15 10:00:34,681 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dbd8762205b2c2c0970dd283f0c093d7 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-15 10:00:34,681 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a59a4a6058a2cac56becff7f4ab5703a 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-15 10:00:34,682 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 10:00:34,682 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,682 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 10:00:34,707 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309150dca3ffd0a064c6cbfdf25f0fd78945f to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309150dca3ffd0a064c6cbfdf25f0fd78945f 2023-09-15 10:00:34,707 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309153199e813aabb4fe7bec78ead662f3e63 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309153199e813aabb4fe7bec78ead662f3e63 2023-09-15 10:00:34,724 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/.tmp/cf/2b9d403044c84eeb83f252faf893d969 2023-09-15 10:00:34,724 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/.tmp/cf/d7e810add69046e7b6f083685ff29cf4 2023-09-15 10:00:34,731 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/.tmp/cf/2b9d403044c84eeb83f252faf893d969 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf/2b9d403044c84eeb83f252faf893d969 2023-09-15 10:00:34,731 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/.tmp/cf/d7e810add69046e7b6f083685ff29cf4 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf/d7e810add69046e7b6f083685ff29cf4 2023-09-15 10:00:34,736 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf/2b9d403044c84eeb83f252faf893d969, entries=44, sequenceid=6, filesize=12.2 K 2023-09-15 10:00:34,736 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf/d7e810add69046e7b6f083685ff29cf4, entries=6, sequenceid=6, filesize=5.9 K 2023-09-15 10:00:34,737 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for a59a4a6058a2cac56becff7f4ab5703a in 56ms, sequenceid=6, compaction requested=false 2023-09-15 10:00:34,738 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for dbd8762205b2c2c0970dd283f0c093d7 in 56ms, sequenceid=6, compaction requested=false 2023-09-15 10:00:34,738 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-15 10:00:34,738 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-15 10:00:34,739 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a59a4a6058a2cac56becff7f4ab5703a: 2023-09-15 10:00:34,739 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dbd8762205b2c2c0970dd283f0c093d7: 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf/d7e810add69046e7b6f083685ff29cf4] hfiles 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf/2b9d403044c84eeb83f252faf893d969] hfiles 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf/d7e810add69046e7b6f083685ff29cf4 for snapshot=snaptb0-testConsecutiveExports 2023-09-15 10:00:34,740 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf/2b9d403044c84eeb83f252faf893d969 for snapshot=snaptb0-testConsecutiveExports 2023-09-15 10:00:34,750 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. completed. 2023-09-15 10:00:34,751 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:00:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 10:00:34,751 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:00:34,752 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. completed. 2023-09-15 10:00:34,752 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 10:00:34,752 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,752 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,752 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 10:00:34,754 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,754 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-15 10:00:34,754 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,754 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-15 10:00:34,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 10:00:34,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:00:34,756 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:00:34,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,34885,1694771995831': 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:00:34,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-15 10:00:34,763 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-15 10:00:34,763 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:00:34,763 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:00:34,763 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-15 10:00:34,763 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:00:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:00:34,764 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,765 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,766 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:00:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,766 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:00:34,768 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-15 10:00:34,768 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,768 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,771 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,771 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,771 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:00:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:00:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-15 10:00:34,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,772 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:00:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:00:34,773 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:00:34,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-15 10:00:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-15 10:00:34,774 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:00:34,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:00:34,774 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:00:34,775 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:00:34,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309150dca3ffd0a064c6cbfdf25f0fd78945f, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309153199e813aabb4fe7bec78ead662f3e63] mob files 2023-09-15 10:00:34,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309150dca3ffd0a064c6cbfdf25f0fd78945f 2023-09-15 10:00:34,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309153199e813aabb4fe7bec78ead662f3e63 2023-09-15 10:00:34,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-15 10:00:34,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-15 10:00:34,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,819 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694772034651Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694772034791 (+140 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694772034791Loading Region manifests for snaptb0-testConsecutiveExports at 1694772034791Writing data manifest for snaptb0-testConsecutiveExports at 1694772034795 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694772034810 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694772034818 (+8 ms) 2023-09-15 10:00:34,821 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-15 10:00:34,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 170 msec 2023-09-15 10:00:34,956 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:00:34,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-15 10:00:34,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:00:34,959 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959 2023-09-15 10:00:34,959 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:34,983 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:34,983 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@64d5c213, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:34,983 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-15 10:00:34,991 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:35,001 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,002 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,002 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,002 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,720 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-1565385356775703909.jar 2023-09-15 10:00:35,721 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,721 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,775 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-4562369035430840665.jar 2023-09-15 10:00:35,775 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,776 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,776 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,776 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,777 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,777 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:35,777 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:00:35,778 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:00:35,778 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:00:35,778 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:00:35,779 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:00:35,779 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:00:35,779 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:00:35,780 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:00:35,780 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:00:35,780 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:00:35,781 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:35,781 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:35,781 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:35,782 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:35,782 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:35,782 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:35,783 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:36,148 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:00:36,151 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-15 10:00:36,153 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-15 10:00:38,130 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:38,130 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:38,132 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0002_000001 (auth:SIMPLE) 2023-09-15 10:00:38,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0003_000001 (auth:SIMPLE) 2023-09-15 10:00:38,842 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:00:41,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0003_000001 (auth:SIMPLE) 2023-09-15 10:00:44,149 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0003_000001 (auth:SIMPLE) 2023-09-15 10:00:46,641 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0003_000001 (auth:SIMPLE) 2023-09-15 10:00:48,369 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:00:48,369 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:00:48,373 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-15 10:00:48,374 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:00:48,374 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:00:48,374 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 10:00:48,378 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 10:00:48,378 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 10:00:48,378 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@76114737 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 10:00:48,378 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 10:00:48,378 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 10:00:48,379 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:48,399 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:00:48,399 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4a18ac6c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:48,399 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-15 10:00:48,410 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-15 10:00:48,421 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:48,421 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:48,422 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:48,422 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,131 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-7277994849345174150.jar 2023-09-15 10:00:49,131 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,131 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,185 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-4541487949527571540.jar 2023-09-15 10:00:49,185 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,185 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,186 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,186 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,186 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,187 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:00:49,187 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:00:49,187 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:00:49,187 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:00:49,188 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:00:49,188 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:00:49,188 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:00:49,189 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:00:49,189 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:00:49,189 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:00:49,190 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:00:49,190 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:49,191 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:49,191 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:49,191 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:49,192 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:00:49,192 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:49,192 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:00:49,527 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:00:49,529 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-15 10:00:49,531 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-15 10:00:52,841 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:52,842 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:00:52,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0003_000001 (auth:SIMPLE) 2023-09-15 10:00:53,680 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0004_000001 (auth:SIMPLE) 2023-09-15 10:00:56,960 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0004_000001 (auth:SIMPLE) 2023-09-15 10:00:59,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0004_000001 (auth:SIMPLE) 2023-09-15 10:01:01,186 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0004_000001 (auth:SIMPLE) 2023-09-15 10:01:02,722 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:01:02,722 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:01:02,725 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-15 10:01:02,725 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:01:02,725 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:01:02,725 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 10:01:02,727 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 10:01:02,727 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 10:01:02,727 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@76114737 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-15 10:01:02,727 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-15 10:01:02,727 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/local-export-1694772034959/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-15 10:01:02,737 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-15 10:01:02,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-09-15 10:01:02,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:02,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 10:01:02,741 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772062741"}]},"ts":"1694772062741"} 2023-09-15 10:01:02,742 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-15 10:01:02,743 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-15 10:01:02,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, UNASSIGN}] 2023-09-15 10:01:02,746 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, UNASSIGN 2023-09-15 10:01:02,746 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, UNASSIGN 2023-09-15 10:01:02,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dbd8762205b2c2c0970dd283f0c093d7, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:02,746 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a59a4a6058a2cac56becff7f4ab5703a, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:02,747 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772062746"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772062746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772062746"}]},"ts":"1694772062746"} 2023-09-15 10:01:02,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772062746"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772062746"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772062746"}]},"ts":"1694772062746"} 2023-09-15 10:01:02,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure dbd8762205b2c2c0970dd283f0c093d7, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 10:01:02,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure a59a4a6058a2cac56becff7f4ab5703a, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:02,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 10:01:02,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:01:02,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing dbd8762205b2c2c0970dd283f0c093d7, disabling compactions & flushes 2023-09-15 10:01:02,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:01:02,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:01:02,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. after waiting 0 ms 2023-09-15 10:01:02,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:01:02,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:01:02,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a59a4a6058a2cac56becff7f4ab5703a, disabling compactions & flushes 2023-09-15 10:01:02,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:01:02,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:01:02,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. after waiting 0 ms 2023-09-15 10:01:02,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:01:02,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:02,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:02,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:02,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:02,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7. 2023-09-15 10:01:02,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for dbd8762205b2c2c0970dd283f0c093d7: 2023-09-15 10:01:02,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a. 2023-09-15 10:01:02,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a59a4a6058a2cac56becff7f4ab5703a: 2023-09-15 10:01:02,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:01:02,924 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dbd8762205b2c2c0970dd283f0c093d7, regionState=CLOSED 2023-09-15 10:01:02,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:01:02,925 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772062924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772062924"}]},"ts":"1694772062924"} 2023-09-15 10:01:02,925 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a59a4a6058a2cac56becff7f4ab5703a, regionState=CLOSED 2023-09-15 10:01:02,925 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694772062925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772062925"}]},"ts":"1694772062925"} 2023-09-15 10:01:02,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-15 10:01:02,928 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure dbd8762205b2c2c0970dd283f0c093d7, server=jenkins-hbase17.apache.org,34885,1694771995831 in 178 msec 2023-09-15 10:01:02,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-15 10:01:02,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure a59a4a6058a2cac56becff7f4ab5703a, server=jenkins-hbase17.apache.org,35307,1694771995748 in 179 msec 2023-09-15 10:01:02,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dbd8762205b2c2c0970dd283f0c093d7, UNASSIGN in 184 msec 2023-09-15 10:01:02,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-15 10:01:02,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a59a4a6058a2cac56becff7f4ab5703a, UNASSIGN in 189 msec 2023-09-15 10:01:02,935 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772062935"}]},"ts":"1694772062935"} 2023-09-15 10:01:02,937 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-15 10:01:02,938 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-15 10:01:02,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 201 msec 2023-09-15 10:01:03,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-15 10:01:03,046 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-15 10:01:03,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-09-15 10:01:03,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:03,054 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:03,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-15 10:01:03,055 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:03,057 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-15 10:01:03,059 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,059 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,059 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,059 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 10:01:03,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 10:01:03,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 10:01:03,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-15 10:01:03,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,060 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-15 10:01:03,061 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,061 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,061 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:01:03,062 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:01:03,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-15 10:01:03,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/recovered.edits] 2023-09-15 10:01:03,064 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/recovered.edits] 2023-09-15 10:01:03,069 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf/2b9d403044c84eeb83f252faf893d969 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/cf/2b9d403044c84eeb83f252faf893d969 2023-09-15 10:01:03,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf/d7e810add69046e7b6f083685ff29cf4 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/cf/d7e810add69046e7b6f083685ff29cf4 2023-09-15 10:01:03,071 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7/recovered.edits/9.seqid 2023-09-15 10:01:03,071 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a/recovered.edits/9.seqid 2023-09-15 10:01:03,072 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/dbd8762205b2c2c0970dd283f0c093d7 2023-09-15 10:01:03,072 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testConsecutiveExports/a59a4a6058a2cac56becff7f4ab5703a 2023-09-15 10:01:03,072 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-15 10:01:03,072 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-15 10:01:03,073 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-15 10:01:03,076 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309150dca3ffd0a064c6cbfdf25f0fd78945f to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309150dca3ffd0a064c6cbfdf25f0fd78945f 2023-09-15 10:01:03,077 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309153199e813aabb4fe7bec78ead662f3e63 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309153199e813aabb4fe7bec78ead662f3e63 2023-09-15 10:01:03,078 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-15 10:01:03,082 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:03,085 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-15 10:01:03,086 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-15 10:01:03,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:03,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-15 10:01:03,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772063088"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:03,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772063088"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:03,090 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 10:01:03,090 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a59a4a6058a2cac56becff7f4ab5703a, NAME => 'testtb-testConsecutiveExports,,1694772033584.a59a4a6058a2cac56becff7f4ab5703a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dbd8762205b2c2c0970dd283f0c093d7, NAME => 'testtb-testConsecutiveExports,1,1694772033584.dbd8762205b2c2c0970dd283f0c093d7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 10:01:03,090 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-15 10:01:03,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772063091"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:03,092 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-15 10:01:03,094 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-15 10:01:03,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 46 msec 2023-09-15 10:01:03,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-15 10:01:03,164 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-15 10:01:03,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-15 10:01:03,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-15 10:01:03,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-09-15 10:01:03,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-15 10:01:03,212 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=758 (was 766), OpenFileDescriptor=917 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 250), ProcessCount=167 (was 168), AvailableMemoryMB=9442 (was 9616) 2023-09-15 10:01:03,212 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-15 10:01:03,230 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=167, AvailableMemoryMB=9441 2023-09-15 10:01:03,230 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-15 10:01:03,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 10:01:03,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:01:03,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-15 10:01:03,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:01:03,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 10:01:03,239 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,239 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,239 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 empty. 2023-09-15 10:01:03,239 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d empty. 2023-09-15 10:01:03,239 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,240 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,240 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-15 10:01:03,256 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-15 10:01:03,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5396c095a360d341fd0f2dbaee32c41, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:03,257 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => e3a1ffa968f5f705969655606b63e86d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing b5396c095a360d341fd0f2dbaee32c41, disabling compactions & flushes 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing e3a1ffa968f5f705969655606b63e86d, disabling compactions & flushes 2023-09-15 10:01:03,272 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,272 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. after waiting 0 ms 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. after waiting 0 ms 2023-09-15 10:01:03,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,273 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,273 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for b5396c095a360d341fd0f2dbaee32c41: 2023-09-15 10:01:03,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for e3a1ffa968f5f705969655606b63e86d: 2023-09-15 10:01:03,275 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:01:03,276 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772063276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772063276"}]},"ts":"1694772063276"} 2023-09-15 10:01:03,276 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772063276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772063276"}]},"ts":"1694772063276"} 2023-09-15 10:01:03,282 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:01:03,283 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:01:03,283 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772063283"}]},"ts":"1694772063283"} 2023-09-15 10:01:03,284 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-15 10:01:03,287 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:01:03,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:01:03,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:01:03,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:01:03,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:01:03,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, ASSIGN}] 2023-09-15 10:01:03,290 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, ASSIGN 2023-09-15 10:01:03,291 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, ASSIGN 2023-09-15 10:01:03,291 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35307,1694771995748; forceNewPlan=false, retain=false 2023-09-15 10:01:03,291 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:01:03,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 10:01:03,441 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:01:03,443 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b5396c095a360d341fd0f2dbaee32c41, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,443 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e3a1ffa968f5f705969655606b63e86d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772063443"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772063443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772063443"}]},"ts":"1694772063443"} 2023-09-15 10:01:03,444 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772063443"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772063443"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772063443"}]},"ts":"1694772063443"} 2023-09-15 10:01:03,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure b5396c095a360d341fd0f2dbaee32c41, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:03,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure e3a1ffa968f5f705969655606b63e86d, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:03,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 10:01:03,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e3a1ffa968f5f705969655606b63e86d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 10:01:03,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5396c095a360d341fd0f2dbaee32c41, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 10:01:03,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. service=AccessControlService 2023-09-15 10:01:03,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. service=AccessControlService 2023-09-15 10:01:03,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:03,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:03,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:03,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:03,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,614 INFO [StoreOpener-e3a1ffa968f5f705969655606b63e86d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,614 INFO [StoreOpener-b5396c095a360d341fd0f2dbaee32c41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,616 DEBUG [StoreOpener-e3a1ffa968f5f705969655606b63e86d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf 2023-09-15 10:01:03,616 DEBUG [StoreOpener-e3a1ffa968f5f705969655606b63e86d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf 2023-09-15 10:01:03,616 DEBUG [StoreOpener-b5396c095a360d341fd0f2dbaee32c41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf 2023-09-15 10:01:03,616 DEBUG [StoreOpener-b5396c095a360d341fd0f2dbaee32c41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf 2023-09-15 10:01:03,617 INFO [StoreOpener-e3a1ffa968f5f705969655606b63e86d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e3a1ffa968f5f705969655606b63e86d columnFamilyName cf 2023-09-15 10:01:03,617 INFO [StoreOpener-b5396c095a360d341fd0f2dbaee32c41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5396c095a360d341fd0f2dbaee32c41 columnFamilyName cf 2023-09-15 10:01:03,619 INFO [StoreOpener-b5396c095a360d341fd0f2dbaee32c41-1] regionserver.HStore(310): Store=b5396c095a360d341fd0f2dbaee32c41/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:03,619 INFO [StoreOpener-e3a1ffa968f5f705969655606b63e86d-1] regionserver.HStore(310): Store=e3a1ffa968f5f705969655606b63e86d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:03,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:03,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:03,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:03,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:03,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b5396c095a360d341fd0f2dbaee32c41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69794625, jitterRate=0.040020957589149475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:03,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e3a1ffa968f5f705969655606b63e86d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69668820, jitterRate=0.03814631700515747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:03,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b5396c095a360d341fd0f2dbaee32c41: 2023-09-15 10:01:03,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e3a1ffa968f5f705969655606b63e86d: 2023-09-15 10:01:03,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41., pid=60, masterSystemTime=1694772063598 2023-09-15 10:01:03,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d., pid=61, masterSystemTime=1694772063598 2023-09-15 10:01:03,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,630 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e3a1ffa968f5f705969655606b63e86d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,630 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772063629"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772063629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772063629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772063629"}]},"ts":"1694772063629"} 2023-09-15 10:01:03,630 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b5396c095a360d341fd0f2dbaee32c41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,630 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772063630"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772063630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772063630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772063630"}]},"ts":"1694772063630"} 2023-09-15 10:01:03,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-15 10:01:03,633 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure e3a1ffa968f5f705969655606b63e86d, server=jenkins-hbase17.apache.org,46549,1694771995795 in 185 msec 2023-09-15 10:01:03,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-15 10:01:03,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, ASSIGN in 345 msec 2023-09-15 10:01:03,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure b5396c095a360d341fd0f2dbaee32c41, server=jenkins-hbase17.apache.org,35307,1694771995748 in 187 msec 2023-09-15 10:01:03,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-15 10:01:03,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, ASSIGN in 346 msec 2023-09-15 10:01:03,637 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:01:03,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772063637"}]},"ts":"1694772063637"} 2023-09-15 10:01:03,638 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-15 10:01:03,640 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:01:03,640 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-15 10:01:03,642 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 10:01:03,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:03,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:03,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:03,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:03,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:03,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 412 msec 2023-09-15 10:01:03,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-15 10:01:03,843 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-15 10:01:03,848 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,848 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,851 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:01:03,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 10:01:03,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772063870 (current time:1694772063870). 2023-09-15 10:01:03,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:03,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x232691af to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:03,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d5cf129, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:03,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:03,879 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:03,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x232691af to 127.0.0.1:62768 2023-09-15 10:01:03,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:03,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x3188cf40 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:03,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26b48b37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:03,888 DEBUG [hconnection-0x4c0bf371-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:03,889 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:03,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:03,896 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:03,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3188cf40 to 127.0.0.1:62768 2023-09-15 10:01:03,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:03,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 10:01:03,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:03,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 10:01:03,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 10:01:03,902 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 10:01:03,903 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694772663903 2023-09-15 10:01:03,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 10:01:03,904 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:03,904 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:03,905 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 10:01:03,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 10:01:03,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-15 10:01:03,907 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 10:01:03,908 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694772663908 2023-09-15 10:01:03,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,918 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-15 10:01:03,918 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:03,920 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-15 10:01:03,920 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-15 10:01:03,920 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,920 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,921 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:03,921 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:03,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:03,921 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:03,921 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:03,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:03,921 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,921 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,922 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 10:01:03,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,923 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 10:01:03,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,923 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 10:01:03,923 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 10:01:03,923 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:03,923 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:03,924 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 10:01:03,925 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 10:01:03,925 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 10:01:03,925 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 10:01:03,923 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:03,925 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 10:01:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 10:01:03,927 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 10:01:03,927 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 10:01:03,926 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 10:01:03,927 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,927 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:03,928 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:03,928 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:03,929 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,929 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:03,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 10:01:03,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1287629e[Count = 1] remaining members to acquire global barrier 2023-09-15 10:01:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:03,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:03,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 10:01:03,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1287629e[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:03,933 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-15 10:01:03,933 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 10:01:03,934 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 10:01:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,934 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,934 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 10:01:03,934 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:03,935 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:03,934 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:03,935 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:03,935 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,935 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,934 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 10:01:03,934 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:03,935 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:03,935 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. started... 2023-09-15 10:01:03,935 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. started... 2023-09-15 10:01:03,936 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e3a1ffa968f5f705969655606b63e86d: 2023-09-15 10:01:03,936 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5396c095a360d341fd0f2dbaee32c41: 2023-09-15 10:01:03,936 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,936 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,937 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:03,937 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:03,937 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:01:03,937 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:01:03,940 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 10:01:03,940 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:03,940 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 10:01:03,948 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. completed. 2023-09-15 10:01:03,948 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. completed. 2023-09-15 10:01:03,949 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:03,949 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 10:01:03,949 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:03,950 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,950 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 10:01:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,950 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 10:01:03,950 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,950 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:03,950 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:03,952 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 10:01:03,950 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 10:01:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:01:03,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-15 10:01:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:03,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:03,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-15 10:01:03,961 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-15 10:01:03,961 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:03,961 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:03,961 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,961 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:03,962 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:03,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:03,962 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:03,963 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,963 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:03,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,964 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:03,965 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:03,965 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:03,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:03,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,968 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:03,968 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:03,967 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:03,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:03,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,968 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:03,968 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:03,968 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:03,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:03,969 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:03,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,969 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:03,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:03,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:03,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:03,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,970 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:03,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:01:03,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:03,970 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:03,970 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,970 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 10:01:03,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:03,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,000 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-15 10:01:04,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694772063903Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694772063977 (+74 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694772063977Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694772063977Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694772063984 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694772063994 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694772064000 (+6 ms) 2023-09-15 10:01:04,002 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 10:01:04,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 99 msec 2023-09-15 10:01:04,005 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:04,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 10:01:04,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:04,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35307] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:01:04,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46549] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:01:04,013 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,013 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:04,013 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:01:04,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 10:01:04,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772064023 (current time:1694772064023). 2023-09-15 10:01:04,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:04,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x0f2310df to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:04,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36f9a754, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:04,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:04,034 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:04,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f2310df to 127.0.0.1:62768 2023-09-15 10:01:04,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:04,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x4a849f4c to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:04,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5db6cb2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:04,042 DEBUG [hconnection-0x260e04ce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:04,046 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:04,052 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a849f4c to 127.0.0.1:62768 2023-09-15 10:01:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-15 10:01:04,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:04,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 10:01:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 10:01:04,058 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 10:01:04,059 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694772664059 2023-09-15 10:01:04,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-15 10:01:04,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,061 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:04,061 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:04,063 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-15 10:01:04,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 10:01:04,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-15 10:01:04,065 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 10:01:04,066 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694772664066 2023-09-15 10:01:04,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,076 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-15 10:01:04,076 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:04,077 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-15 10:01:04,077 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-15 10:01:04,078 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,078 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,079 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,079 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:04,079 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:04,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:04,079 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:04,079 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,079 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:04,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:04,079 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,079 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 10:01:04,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 10:01:04,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-15 10:01:04,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,081 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 10:01:04,081 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 10:01:04,081 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:04,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,082 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 10:01:04,082 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 10:01:04,081 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:04,083 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 10:01:04,082 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-15 10:01:04,084 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:04,084 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 10:01:04,085 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 10:01:04,085 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-15 10:01:04,085 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-15 10:01:04,085 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 10:01:04,085 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-15 10:01:04,086 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,086 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:04,087 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,087 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673f236d[Count = 1] remaining members to acquire global barrier 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:04,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-15 10:01:04,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@673f236d[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:04,091 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-15 10:01:04,091 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,091 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,091 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,091 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 10:01:04,092 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,092 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:04,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:04,092 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:04,092 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:04,092 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:04,092 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. started... 2023-09-15 10:01:04,093 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. started... 2023-09-15 10:01:04,093 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5396c095a360d341fd0f2dbaee32c41 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-15 10:01:04,093 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e3a1ffa968f5f705969655606b63e86d 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-15 10:01:04,093 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 10:01:04,093 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:04,093 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 10:01:04,112 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915c77cccc8df684dae8fc80d28b6c3fd96 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915c77cccc8df684dae8fc80d28b6c3fd96 2023-09-15 10:01:04,112 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915bd7c1142d7af473eba0240e0418a43ef to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230915bd7c1142d7af473eba0240e0418a43ef 2023-09-15 10:01:04,119 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/.tmp/cf/1cc7904786da43b7b5bddacfec01ca32 2023-09-15 10:01:04,119 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/.tmp/cf/f6d48a73fb1146a8ba3443bdf7458012 2023-09-15 10:01:04,124 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/.tmp/cf/1cc7904786da43b7b5bddacfec01ca32 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf/1cc7904786da43b7b5bddacfec01ca32 2023-09-15 10:01:04,124 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/.tmp/cf/f6d48a73fb1146a8ba3443bdf7458012 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf/f6d48a73fb1146a8ba3443bdf7458012 2023-09-15 10:01:04,129 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf/f6d48a73fb1146a8ba3443bdf7458012, entries=48, sequenceid=6, filesize=13.7 K 2023-09-15 10:01:04,129 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf/1cc7904786da43b7b5bddacfec01ca32, entries=2, sequenceid=6, filesize=5.3 K 2023-09-15 10:01:04,130 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e3a1ffa968f5f705969655606b63e86d in 37ms, sequenceid=6, compaction requested=false 2023-09-15 10:01:04,130 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for b5396c095a360d341fd0f2dbaee32c41 in 37ms, sequenceid=6, compaction requested=false 2023-09-15 10:01:04,131 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-15 10:01:04,131 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-15 10:01:04,133 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5396c095a360d341fd0f2dbaee32c41: 2023-09-15 10:01:04,133 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e3a1ffa968f5f705969655606b63e86d: 2023-09-15 10:01:04,133 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,133 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,133 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:04,133 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:04,134 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf/1cc7904786da43b7b5bddacfec01ca32] hfiles 2023-09-15 10:01:04,134 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf/f6d48a73fb1146a8ba3443bdf7458012] hfiles 2023-09-15 10:01:04,134 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf/1cc7904786da43b7b5bddacfec01ca32 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,134 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf/f6d48a73fb1146a8ba3443bdf7458012 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,141 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. completed. 2023-09-15 10:01:04,141 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:04,142 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:04,142 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:04,142 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,142 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 10:01:04,142 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:04,142 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. completed. 2023-09-15 10:01:04,142 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:04,143 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:04,143 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:04,143 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,143 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 10:01:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:04,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:04,143 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:04,143 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,143 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 10:01:04,144 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-15 10:01:04,144 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:04,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:04,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:04,146 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,146 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-15 10:01:04,146 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:04,146 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-15 10:01:04,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:04,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:01:04,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-15 10:01:04,152 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-15 10:01:04,152 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:04,152 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:04,152 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,152 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:04,153 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:04,153 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:04,153 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:04,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,154 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:04,154 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:04,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,154 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:04,155 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,156 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:04,156 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,157 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,158 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:04,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:04,159 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:04,160 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:04,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:04,159 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:04,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:04,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,160 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:04,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:01:04,161 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:04,161 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,161 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:04,161 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,162 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:04,162 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,162 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230915bd7c1142d7af473eba0240e0418a43ef, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915c77cccc8df684dae8fc80d28b6c3fd96] mob files 2023-09-15 10:01:04,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230915bd7c1142d7af473eba0240e0418a43ef 2023-09-15 10:01:04,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915c77cccc8df684dae8fc80d28b6c3fd96 2023-09-15 10:01:04,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 10:01:04,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:01:04,163 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:01:04,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-15 10:01:04,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,193 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:04,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694772064059Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694772064170 (+111 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694772064170Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694772064170Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694772064173 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694772064182 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694772064192 (+10 ms) 2023-09-15 10:01:04,195 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-15 10:01:04,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 134 msec 2023-09-15 10:01:04,363 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:04,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-15 10:01:04,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:04,398 DEBUG [Listener at jenkins-hbase17.apache.org/42523] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 10:01:04,402 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 10:01:04,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34885] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 10:01:04,404 DEBUG [Listener at jenkins-hbase17.apache.org/42523] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 10:01:04,407 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 10:01:04,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35307] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 10:01:04,408 DEBUG [Listener at jenkins-hbase17.apache.org/42523] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-15 10:01:04,414 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-15 10:01:04,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46549] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-15 10:01:04,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-15 10:01:04,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:04,420 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:01:04,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-15 10:01:04,421 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:01:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 10:01:04,423 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,423 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,424 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 empty. 2023-09-15 10:01:04,424 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c empty. 2023-09-15 10:01:04,424 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,424 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,424 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-15 10:01:04,433 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-15 10:01:04,435 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 99d392bf2d815520eb347b9e7d6c4bc3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:04,435 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => aa5a44c3326318cd8351a253c267762c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:04,443 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing aa5a44c3326318cd8351a253c267762c, disabling compactions & flushes 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 99d392bf2d815520eb347b9e7d6c4bc3, disabling compactions & flushes 2023-09-15 10:01:04,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. after waiting 0 ms 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. after waiting 0 ms 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for aa5a44c3326318cd8351a253c267762c: 2023-09-15 10:01:04,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 99d392bf2d815520eb347b9e7d6c4bc3: 2023-09-15 10:01:04,447 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:01:04,448 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772064448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772064448"}]},"ts":"1694772064448"} 2023-09-15 10:01:04,448 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772064448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772064448"}]},"ts":"1694772064448"} 2023-09-15 10:01:04,450 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:01:04,451 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:01:04,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772064451"}]},"ts":"1694772064451"} 2023-09-15 10:01:04,453 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-15 10:01:04,455 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:01:04,456 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:01:04,456 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:01:04,456 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:01:04,456 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:01:04,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, ASSIGN}] 2023-09-15 10:01:04,459 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, ASSIGN 2023-09-15 10:01:04,459 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, ASSIGN 2023-09-15 10:01:04,460 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:01:04,460 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35307,1694771995748; forceNewPlan=false, retain=false 2023-09-15 10:01:04,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 10:01:04,610 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:01:04,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=99d392bf2d815520eb347b9e7d6c4bc3, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,615 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=aa5a44c3326318cd8351a253c267762c, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772064615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772064615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772064615"}]},"ts":"1694772064615"} 2023-09-15 10:01:04,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772064615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772064615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772064615"}]},"ts":"1694772064615"} 2023-09-15 10:01:04,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 99d392bf2d815520eb347b9e7d6c4bc3, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:04,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure aa5a44c3326318cd8351a253c267762c, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:04,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 10:01:04,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99d392bf2d815520eb347b9e7d6c4bc3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.', STARTKEY => '', ENDKEY => '2'} 2023-09-15 10:01:04,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aa5a44c3326318cd8351a253c267762c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.', STARTKEY => '2', ENDKEY => ''} 2023-09-15 10:01:04,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. service=AccessControlService 2023-09-15 10:01:04,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. service=AccessControlService 2023-09-15 10:01:04,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:04,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:04,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:04,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:04,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,783 INFO [StoreOpener-aa5a44c3326318cd8351a253c267762c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,783 INFO [StoreOpener-99d392bf2d815520eb347b9e7d6c4bc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,784 DEBUG [StoreOpener-aa5a44c3326318cd8351a253c267762c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf 2023-09-15 10:01:04,784 DEBUG [StoreOpener-aa5a44c3326318cd8351a253c267762c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf 2023-09-15 10:01:04,784 DEBUG [StoreOpener-99d392bf2d815520eb347b9e7d6c4bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf 2023-09-15 10:01:04,784 DEBUG [StoreOpener-99d392bf2d815520eb347b9e7d6c4bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf 2023-09-15 10:01:04,785 INFO [StoreOpener-aa5a44c3326318cd8351a253c267762c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa5a44c3326318cd8351a253c267762c columnFamilyName cf 2023-09-15 10:01:04,785 INFO [StoreOpener-99d392bf2d815520eb347b9e7d6c4bc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99d392bf2d815520eb347b9e7d6c4bc3 columnFamilyName cf 2023-09-15 10:01:04,785 INFO [StoreOpener-aa5a44c3326318cd8351a253c267762c-1] regionserver.HStore(310): Store=aa5a44c3326318cd8351a253c267762c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:04,785 INFO [StoreOpener-99d392bf2d815520eb347b9e7d6c4bc3-1] regionserver.HStore(310): Store=99d392bf2d815520eb347b9e7d6c4bc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:04,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:04,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:04,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:04,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:04,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened aa5a44c3326318cd8351a253c267762c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66691106, jitterRate=-0.006225079298019409}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:04,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 99d392bf2d815520eb347b9e7d6c4bc3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68621497, jitterRate=0.022539988160133362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:04,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for aa5a44c3326318cd8351a253c267762c: 2023-09-15 10:01:04,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 99d392bf2d815520eb347b9e7d6c4bc3: 2023-09-15 10:01:04,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c., pid=70, masterSystemTime=1694772064773 2023-09-15 10:01:04,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3., pid=69, masterSystemTime=1694772064772 2023-09-15 10:01:04,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:04,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=aa5a44c3326318cd8351a253c267762c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:04,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:04,794 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772064794"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772064794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772064794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772064794"}]},"ts":"1694772064794"} 2023-09-15 10:01:04,794 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=99d392bf2d815520eb347b9e7d6c4bc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:04,794 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772064794"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772064794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772064794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772064794"}]},"ts":"1694772064794"} 2023-09-15 10:01:04,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-15 10:01:04,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure aa5a44c3326318cd8351a253c267762c, server=jenkins-hbase17.apache.org,35307,1694771995748 in 175 msec 2023-09-15 10:01:04,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-15 10:01:04,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 99d392bf2d815520eb347b9e7d6c4bc3, server=jenkins-hbase17.apache.org,46549,1694771995795 in 178 msec 2023-09-15 10:01:04,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, ASSIGN in 339 msec 2023-09-15 10:01:04,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-15 10:01:04,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, ASSIGN in 340 msec 2023-09-15 10:01:04,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:01:04,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772064799"}]},"ts":"1694772064799"} 2023-09-15 10:01:04,800 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-15 10:01:04,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:01:04,802 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-15 10:01:04,803 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-15 10:01:04,804 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:04,804 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:04,804 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:04,804 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:04,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:04,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 388 msec 2023-09-15 10:01:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-15 10:01:05,029 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-15 10:01:05,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions 99d392bf2d815520eb347b9e7d6c4bc3, aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:05,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[99d392bf2d815520eb347b9e7d6c4bc3, aa5a44c3326318cd8351a253c267762c], force=true 2023-09-15 10:01:05,068 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[99d392bf2d815520eb347b9e7d6c4bc3, aa5a44c3326318cd8351a253c267762c], force=true 2023-09-15 10:01:05,068 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[99d392bf2d815520eb347b9e7d6c4bc3, aa5a44c3326318cd8351a253c267762c], force=true 2023-09-15 10:01:05,068 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[99d392bf2d815520eb347b9e7d6c4bc3, aa5a44c3326318cd8351a253c267762c], force=true 2023-09-15 10:01:05,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 10:01:05,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, UNASSIGN}] 2023-09-15 10:01:05,093 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, UNASSIGN 2023-09-15 10:01:05,093 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, UNASSIGN 2023-09-15 10:01:05,093 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=99d392bf2d815520eb347b9e7d6c4bc3, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:05,093 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=aa5a44c3326318cd8351a253c267762c, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:05,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772065093"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772065093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772065093"}]},"ts":"1694772065093"} 2023-09-15 10:01:05,094 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772065093"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772065093"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772065093"}]},"ts":"1694772065093"} 2023-09-15 10:01:05,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 99d392bf2d815520eb347b9e7d6c4bc3, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:05,095 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure aa5a44c3326318cd8351a253c267762c, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:05,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 10:01:05,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:05,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:05,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 99d392bf2d815520eb347b9e7d6c4bc3, disabling compactions & flushes 2023-09-15 10:01:05,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing aa5a44c3326318cd8351a253c267762c, disabling compactions & flushes 2023-09-15 10:01:05,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:05,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. after waiting 0 ms 2023-09-15 10:01:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. after waiting 0 ms 2023-09-15 10:01:05,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:05,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 99d392bf2d815520eb347b9e7d6c4bc3 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-15 10:01:05,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing aa5a44c3326318cd8351a253c267762c 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-15 10:01:05,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/.tmp/cf/5a06a2d2ab034ab0bbce53ceef35b48c 2023-09-15 10:01:05,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/.tmp/cf/9a830a7427264272a8df097503bbaeb3 2023-09-15 10:01:05,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/.tmp/cf/5a06a2d2ab034ab0bbce53ceef35b48c as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf/5a06a2d2ab034ab0bbce53ceef35b48c 2023-09-15 10:01:05,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/.tmp/cf/9a830a7427264272a8df097503bbaeb3 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf/9a830a7427264272a8df097503bbaeb3 2023-09-15 10:01:05,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf/9a830a7427264272a8df097503bbaeb3, entries=1, sequenceid=5, filesize=4.7 K 2023-09-15 10:01:05,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 99d392bf2d815520eb347b9e7d6c4bc3 in 27ms, sequenceid=5, compaction requested=false 2023-09-15 10:01:05,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-15 10:01:05,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf/5a06a2d2ab034ab0bbce53ceef35b48c, entries=1, sequenceid=5, filesize=4.7 K 2023-09-15 10:01:05,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-15 10:01:05,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for aa5a44c3326318cd8351a253c267762c in 33ms, sequenceid=5, compaction requested=false 2023-09-15 10:01:05,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:05,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3. 2023-09-15 10:01:05,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 99d392bf2d815520eb347b9e7d6c4bc3: 2023-09-15 10:01:05,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:05,292 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=99d392bf2d815520eb347b9e7d6c4bc3, regionState=CLOSED 2023-09-15 10:01:05,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772065292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772065292"}]},"ts":"1694772065292"} 2023-09-15 10:01:05,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-15 10:01:05,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:05,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c. 2023-09-15 10:01:05,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for aa5a44c3326318cd8351a253c267762c: 2023-09-15 10:01:05,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-15 10:01:05,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 99d392bf2d815520eb347b9e7d6c4bc3, server=jenkins-hbase17.apache.org,46549,1694771995795 in 198 msec 2023-09-15 10:01:05,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:05,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=aa5a44c3326318cd8351a253c267762c, regionState=CLOSED 2023-09-15 10:01:05,295 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694772065295"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772065295"}]},"ts":"1694772065295"} 2023-09-15 10:01:05,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=99d392bf2d815520eb347b9e7d6c4bc3, UNASSIGN in 207 msec 2023-09-15 10:01:05,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-15 10:01:05,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure aa5a44c3326318cd8351a253c267762c, server=jenkins-hbase17.apache.org,35307,1694771995748 in 201 msec 2023-09-15 10:01:05,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-15 10:01:05,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=aa5a44c3326318cd8351a253c267762c, UNASSIGN in 207 msec 2023-09-15 10:01:05,339 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-15 10:01:05,340 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064417.99d392bf2d815520eb347b9e7d6c4bc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:05,341 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694772064417.aa5a44c3326318cd8351a253c267762c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:05,341 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:05,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 10:01:05,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, ASSIGN}] 2023-09-15 10:01:05,382 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, ASSIGN 2023-09-15 10:01:05,383 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:01:05,533 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-15 10:01:05,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=986576eabe4af6fa5de04d5f04fd7246, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:05,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694772065535"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772065535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772065535"}]},"ts":"1694772065535"} 2023-09-15 10:01:05,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 986576eabe4af6fa5de04d5f04fd7246, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:05,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 10:01:05,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:05,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 986576eabe4af6fa5de04d5f04fd7246, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.', STARTKEY => '', ENDKEY => ''} 2023-09-15 10:01:05,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. service=AccessControlService 2023-09-15 10:01:05,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:05,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:05,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/.regioninfo 2023-09-15 10:01:05,704 INFO [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,704 DEBUG [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf 2023-09-15 10:01:05,704 DEBUG [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf 2023-09-15 10:01:05,705 INFO [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 986576eabe4af6fa5de04d5f04fd7246 columnFamilyName cf 2023-09-15 10:01:05,731 DEBUG [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] regionserver.HStore(539): loaded hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/5a06a2d2ab034ab0bbce53ceef35b48c.aa5a44c3326318cd8351a253c267762c->hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf/5a06a2d2ab034ab0bbce53ceef35b48c-top 2023-09-15 10:01:05,736 DEBUG [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] regionserver.HStore(539): loaded hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/9a830a7427264272a8df097503bbaeb3.99d392bf2d815520eb347b9e7d6c4bc3->hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf/9a830a7427264272a8df097503bbaeb3-top 2023-09-15 10:01:05,737 INFO [StoreOpener-986576eabe4af6fa5de04d5f04fd7246-1] regionserver.HStore(310): Store=986576eabe4af6fa5de04d5f04fd7246/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:05,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:05,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 986576eabe4af6fa5de04d5f04fd7246; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60743174, jitterRate=-0.09485617280006409}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:05,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 986576eabe4af6fa5de04d5f04fd7246: 2023-09-15 10:01:05,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246., pid=77, masterSystemTime=1694772065690 2023-09-15 10:01:05,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.,because compaction is disabled. 2023-09-15 10:01:05,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:05,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:05,746 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=986576eabe4af6fa5de04d5f04fd7246, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:05,746 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694772065746"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772065746"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772065746"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772065746"}]},"ts":"1694772065746"} 2023-09-15 10:01:05,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-15 10:01:05,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 986576eabe4af6fa5de04d5f04fd7246, server=jenkins-hbase17.apache.org,46549,1694771995795 in 209 msec 2023-09-15 10:01:05,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-15 10:01:05,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, ASSIGN in 368 msec 2023-09-15 10:01:05,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[99d392bf2d815520eb347b9e7d6c4bc3, aa5a44c3326318cd8351a253c267762c], force=true in 689 msec 2023-09-15 10:01:06,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-15 10:01:06,180 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-15 10:01:06,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 10:01:06,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772066183 (current time:1694772066183). 2023-09-15 10:01:06,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:06,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x454d91d8 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:06,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ba15976, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:06,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:06,199 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:06,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x454d91d8 to 127.0.0.1:62768 2023-09-15 10:01:06,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:06,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x5aaf08e2 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:06,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73c5813e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:06,209 DEBUG [hconnection-0x12ce0cd9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:06,213 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:06,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:06,221 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:06,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aaf08e2 to 127.0.0.1:62768 2023-09-15 10:01:06,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:06,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-15 10:01:06,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:06,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 10:01:06,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 10:01:06,228 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 10:01:06,229 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694772666229 2023-09-15 10:01:06,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-15 10:01:06,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,233 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:06,233 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:06,234 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-15 10:01:06,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 10:01:06,236 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-09-15 10:01:06,237 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 10:01:06,238 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694772666238 2023-09-15 10:01:06,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,248 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-15 10:01:06,248 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:06,250 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-15 10:01:06,250 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-15 10:01:06,251 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,251 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,252 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:06,252 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:06,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:06,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:06,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:06,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:06,252 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,252 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:06,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:06,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,253 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,253 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 10:01:06,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,254 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 10:01:06,254 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 10:01:06,254 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,256 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 10:01:06,256 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 10:01:06,256 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 10:01:06,254 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:06,256 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-15 10:01:06,258 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 10:01:06,258 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 10:01:06,258 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 10:01:06,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,258 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-15 10:01:06,258 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:06,259 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-15 10:01:06,259 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-15 10:01:06,259 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-15 10:01:06,260 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,260 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:06,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:06,261 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:06,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:06,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-15 10:01:06,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d42380[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:06,263 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-15 10:01:06,264 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 10:01:06,265 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,265 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:06,265 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:06,265 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:06,265 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. started... 2023-09-15 10:01:06,267 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 986576eabe4af6fa5de04d5f04fd7246: 2023-09-15 10:01:06,267 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,267 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:06,267 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/5a06a2d2ab034ab0bbce53ceef35b48c.aa5a44c3326318cd8351a253c267762c->hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf/5a06a2d2ab034ab0bbce53ceef35b48c-top, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/9a830a7427264272a8df097503bbaeb3.99d392bf2d815520eb347b9e7d6c4bc3->hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf/9a830a7427264272a8df097503bbaeb3-top] hfiles 2023-09-15 10:01:06,267 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 10:01:06,267 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/5a06a2d2ab034ab0bbce53ceef35b48c.aa5a44c3326318cd8351a253c267762c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,267 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:06,268 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 10:01:06,269 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 10:01:06,269 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:06,269 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 10:01:06,273 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/9a830a7427264272a8df097503bbaeb3.99d392bf2d815520eb347b9e7d6c4bc3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,279 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. completed. 2023-09-15 10:01:06,279 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:06,279 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:06,279 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:06,279 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,279 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-15 10:01:06,279 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:06,282 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,282 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-15 10:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:06,282 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:06,282 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-15 10:01:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:06,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:06,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-15 10:01:06,285 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-15 10:01:06,286 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:06,286 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:06,286 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,286 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,287 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:06,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:06,288 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:06,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,288 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,290 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,290 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:06,291 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,294 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,294 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,294 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,294 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:06,294 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,295 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:06,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:06,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:06,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:06,296 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:06,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:06,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:06,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:06,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:06,295 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:06,296 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:06,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:06,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,297 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,297 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:06,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,323 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-15 10:01:06,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,323 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694772066229Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694772066295 (+66 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694772066296 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694772066304 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694772066316 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694772066323 (+7 ms) 2023-09-15 10:01:06,326 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-15 10:01:06,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-09-15 10:01:06,333 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:06,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-15 10:01:06,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:06,334 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334 2023-09-15 10:01:06,334 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38409, tgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334, rawTgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:01:06,352 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:01:06,352 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1876550748_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,352 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-15 10:01:06,360 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:06,381 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:06,382 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:06,382 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:06,383 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,121 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-512204717425334050.jar 2023-09-15 10:01:07,122 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,122 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,176 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-3152104375161708595.jar 2023-09-15 10:01:07,176 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,177 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,177 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,177 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,177 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,178 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:07,178 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:01:07,178 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:01:07,179 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:01:07,179 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:01:07,179 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:01:07,180 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:01:07,180 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:01:07,180 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:01:07,180 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:01:07,181 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:01:07,181 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:07,182 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:07,182 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:07,182 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:07,182 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:07,183 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:07,183 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:07,386 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0004_000001 (auth:SIMPLE) 2023-09-15 10:01:07,519 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:01:07,521 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-15 10:01:07,523 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-15 10:01:07,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:01:07,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:01:07,863 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0005_000001 (auth:SIMPLE) 2023-09-15 10:01:08,507 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:01:11,167 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0005_000001 (auth:SIMPLE) 2023-09-15 10:01:13,371 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0005_000001 (auth:SIMPLE) 2023-09-15 10:01:15,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0005_000001 (auth:SIMPLE) 2023-09-15 10:01:17,699 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:01:17,702 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:01:17,710 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:17,710 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:01:17,711 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:01:17,711 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:17,712 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-15 10:01:17,712 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-15 10:01:17,712 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:17,713 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-15 10:01:17,713 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772066334/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-15 10:01:17,720 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:17,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:17,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:17,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 10:01:17,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772077726"}]},"ts":"1694772077726"} 2023-09-15 10:01:17,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-15 10:01:17,729 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-15 10:01:17,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, UNASSIGN}] 2023-09-15 10:01:17,730 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, UNASSIGN 2023-09-15 10:01:17,731 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=986576eabe4af6fa5de04d5f04fd7246, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:17,731 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694772077731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772077731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772077731"}]},"ts":"1694772077731"} 2023-09-15 10:01:17,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 986576eabe4af6fa5de04d5f04fd7246, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:17,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 10:01:17,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:17,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 986576eabe4af6fa5de04d5f04fd7246, disabling compactions & flushes 2023-09-15 10:01:17,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:17,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:17,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. after waiting 0 ms 2023-09-15 10:01:17,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:17,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-15 10:01:17,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:17,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246. 2023-09-15 10:01:17,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 986576eabe4af6fa5de04d5f04fd7246: 2023-09-15 10:01:17,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:17,908 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=986576eabe4af6fa5de04d5f04fd7246, regionState=CLOSED 2023-09-15 10:01:17,908 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694772077908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772077908"}]},"ts":"1694772077908"} 2023-09-15 10:01:17,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-15 10:01:17,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 986576eabe4af6fa5de04d5f04fd7246, server=jenkins-hbase17.apache.org,46549,1694771995795 in 176 msec 2023-09-15 10:01:17,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-15 10:01:17,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=986576eabe4af6fa5de04d5f04fd7246, UNASSIGN in 182 msec 2023-09-15 10:01:17,913 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772077913"}]},"ts":"1694772077913"} 2023-09-15 10:01:17,914 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-15 10:01:17,915 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-15 10:01:17,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 195 msec 2023-09-15 10:01:18,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-15 10:01:18,030 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-15 10:01:18,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,037 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,038 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,039 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,040 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,040 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,041 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,040 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,041 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-15 10:01:18,041 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,041 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-15 10:01:18,041 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,041 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:18,042 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-15 10:01:18,042 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:01:18,042 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:18,042 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:01:18,042 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,041 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-15 10:01:18,042 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:18,042 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:01:18,042 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:18,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-15 10:01:18,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:18,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:18,043 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:18,044 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/recovered.edits] 2023-09-15 10:01:18,044 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/recovered.edits] 2023-09-15 10:01:18,044 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/recovered.edits] 2023-09-15 10:01:18,047 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf/5a06a2d2ab034ab0bbce53ceef35b48c to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/cf/5a06a2d2ab034ab0bbce53ceef35b48c 2023-09-15 10:01:18,047 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/5a06a2d2ab034ab0bbce53ceef35b48c.aa5a44c3326318cd8351a253c267762c to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/5a06a2d2ab034ab0bbce53ceef35b48c.aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:18,047 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf/9a830a7427264272a8df097503bbaeb3 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/cf/9a830a7427264272a8df097503bbaeb3 2023-09-15 10:01:18,048 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/9a830a7427264272a8df097503bbaeb3.99d392bf2d815520eb347b9e7d6c4bc3 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/cf/9a830a7427264272a8df097503bbaeb3.99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:18,050 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/recovered.edits/8.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c/recovered.edits/8.seqid 2023-09-15 10:01:18,050 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/recovered.edits/8.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3/recovered.edits/8.seqid 2023-09-15 10:01:18,051 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/aa5a44c3326318cd8351a253c267762c 2023-09-15 10:01:18,051 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/99d392bf2d815520eb347b9e7d6c4bc3 2023-09-15 10:01:18,051 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/recovered.edits/12.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246/recovered.edits/12.seqid 2023-09-15 10:01:18,052 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/986576eabe4af6fa5de04d5f04fd7246 2023-09-15 10:01:18,052 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-15 10:01:18,054 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,056 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-15 10:01:18,058 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-15 10:01:18,059 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,059 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-15 10:01:18,059 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772078059"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:18,061 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-15 10:01:18,061 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 986576eabe4af6fa5de04d5f04fd7246, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694772064418.986576eabe4af6fa5de04d5f04fd7246.', STARTKEY => '', ENDKEY => ''}] 2023-09-15 10:01:18,061 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-15 10:01:18,061 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772078061"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:18,063 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-15 10:01:18,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 31 msec 2023-09-15 10:01:18,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-15 10:01:18,146 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-15 10:01:18,147 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 10:01:18,154 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772078154"}]},"ts":"1694772078154"} 2023-09-15 10:01:18,155 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-15 10:01:18,156 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-15 10:01:18,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, UNASSIGN}] 2023-09-15 10:01:18,159 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, UNASSIGN 2023-09-15 10:01:18,159 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, UNASSIGN 2023-09-15 10:01:18,160 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e3a1ffa968f5f705969655606b63e86d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:18,160 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b5396c095a360d341fd0f2dbaee32c41, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:18,160 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772078160"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772078160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772078160"}]},"ts":"1694772078160"} 2023-09-15 10:01:18,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772078160"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772078160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772078160"}]},"ts":"1694772078160"} 2023-09-15 10:01:18,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure b5396c095a360d341fd0f2dbaee32c41, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:18,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure e3a1ffa968f5f705969655606b63e86d, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:18,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 10:01:18,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:18,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:18,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b5396c095a360d341fd0f2dbaee32c41, disabling compactions & flushes 2023-09-15 10:01:18,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:18,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:18,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. after waiting 0 ms 2023-09-15 10:01:18,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:18,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e3a1ffa968f5f705969655606b63e86d, disabling compactions & flushes 2023-09-15 10:01:18,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:18,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:18,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. after waiting 0 ms 2023-09-15 10:01:18,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:18,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:18,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:18,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:18,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:18,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d. 2023-09-15 10:01:18,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e3a1ffa968f5f705969655606b63e86d: 2023-09-15 10:01:18,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41. 2023-09-15 10:01:18,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b5396c095a360d341fd0f2dbaee32c41: 2023-09-15 10:01:18,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:18,332 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b5396c095a360d341fd0f2dbaee32c41, regionState=CLOSED 2023-09-15 10:01:18,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:18,332 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772078332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772078332"}]},"ts":"1694772078332"} 2023-09-15 10:01:18,332 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e3a1ffa968f5f705969655606b63e86d, regionState=CLOSED 2023-09-15 10:01:18,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694772078332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772078332"}]},"ts":"1694772078332"} 2023-09-15 10:01:18,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-15 10:01:18,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure b5396c095a360d341fd0f2dbaee32c41, server=jenkins-hbase17.apache.org,35307,1694771995748 in 173 msec 2023-09-15 10:01:18,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-15 10:01:18,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure e3a1ffa968f5f705969655606b63e86d, server=jenkins-hbase17.apache.org,46549,1694771995795 in 172 msec 2023-09-15 10:01:18,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b5396c095a360d341fd0f2dbaee32c41, UNASSIGN in 178 msec 2023-09-15 10:01:18,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-15 10:01:18,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e3a1ffa968f5f705969655606b63e86d, UNASSIGN in 179 msec 2023-09-15 10:01:18,338 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772078338"}]},"ts":"1694772078338"} 2023-09-15 10:01:18,339 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-15 10:01:18,340 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-15 10:01:18,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-09-15 10:01:18,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-15 10:01:18,459 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-15 10:01:18,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,468 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,470 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,471 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,473 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,473 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,473 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,473 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 10:01:18,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 10:01:18,473 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-15 10:01:18,474 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:01:18,474 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:18,475 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:18,475 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:18,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-15 10:01:18,478 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/recovered.edits] 2023-09-15 10:01:18,478 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/recovered.edits] 2023-09-15 10:01:18,481 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf/1cc7904786da43b7b5bddacfec01ca32 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/cf/1cc7904786da43b7b5bddacfec01ca32 2023-09-15 10:01:18,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf/f6d48a73fb1146a8ba3443bdf7458012 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/cf/f6d48a73fb1146a8ba3443bdf7458012 2023-09-15 10:01:18,484 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d/recovered.edits/9.seqid 2023-09-15 10:01:18,484 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41/recovered.edits/9.seqid 2023-09-15 10:01:18,485 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e3a1ffa968f5f705969655606b63e86d 2023-09-15 10:01:18,485 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b5396c095a360d341fd0f2dbaee32c41 2023-09-15 10:01:18,485 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-15 10:01:18,485 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-15 10:01:18,486 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-15 10:01:18,489 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230915bd7c1142d7af473eba0240e0418a43ef to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230915bd7c1142d7af473eba0240e0418a43ef 2023-09-15 10:01:18,490 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915c77cccc8df684dae8fc80d28b6c3fd96 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230915c77cccc8df684dae8fc80d28b6c3fd96 2023-09-15 10:01:18,491 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-15 10:01:18,492 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,494 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-15 10:01:18,496 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-15 10:01:18,497 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,497 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-15 10:01:18,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772078497"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:18,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772078497"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:18,499 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 10:01:18,499 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b5396c095a360d341fd0f2dbaee32c41, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694772063232.b5396c095a360d341fd0f2dbaee32c41.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e3a1ffa968f5f705969655606b63e86d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694772063232.e3a1ffa968f5f705969655606b63e86d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 10:01:18,499 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-15 10:01:18,499 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772078499"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:18,500 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-15 10:01:18,501 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 39 msec 2023-09-15 10:01:18,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-15 10:01:18,580 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-15 10:01:18,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-15 10:01:18,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-15 10:01:18,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-15 10:01:18,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-15 10:01:18,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-15 10:01:18,635 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 758) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:41977 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1138094323_1 at /127.0.0.1:36300 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:36862 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:36878 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1138094323_1 at /127.0.0.1:59108 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3955 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:59136 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:36310 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 206) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9315 (was 9441) 2023-09-15 10:01:18,636 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-15 10:01:18,658 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=167, AvailableMemoryMB=9315 2023-09-15 10:01:18,659 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-15 10:01:18,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 10:01:18,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:18,663 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:01:18,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-15 10:01:18,663 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:01:18,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 10:01:18,665 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:18,665 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb 2023-09-15 10:01:18,666 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 empty. 2023-09-15 10:01:18,666 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb empty. 2023-09-15 10:01:18,666 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:18,666 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb 2023-09-15 10:01:18,666 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-15 10:01:18,677 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-15 10:01:18,678 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2fb88af62f7dc823bab0d94734f5bf08, NAME => 'testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:18,678 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 45df39f100180268fd878098f47565eb, NAME => 'testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:18,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:18,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:18,688 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 45df39f100180268fd878098f47565eb, disabling compactions & flushes 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2fb88af62f7dc823bab0d94734f5bf08, disabling compactions & flushes 2023-09-15 10:01:18,689 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:18,689 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. after waiting 0 ms 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. after waiting 0 ms 2023-09-15 10:01:18,689 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 45df39f100180268fd878098f47565eb: 2023-09-15 10:01:18,689 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:18,689 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2fb88af62f7dc823bab0d94734f5bf08: 2023-09-15 10:01:18,692 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:01:18,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772078693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772078693"}]},"ts":"1694772078693"} 2023-09-15 10:01:18,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772078693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772078693"}]},"ts":"1694772078693"} 2023-09-15 10:01:18,695 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:01:18,696 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:01:18,696 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772078696"}]},"ts":"1694772078696"} 2023-09-15 10:01:18,698 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-15 10:01:18,701 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:01:18,702 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:01:18,702 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:01:18,702 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:01:18,702 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:01:18,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, ASSIGN}] 2023-09-15 10:01:18,705 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, ASSIGN 2023-09-15 10:01:18,705 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, ASSIGN 2023-09-15 10:01:18,706 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35307,1694771995748; forceNewPlan=false, retain=false 2023-09-15 10:01:18,706 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:01:18,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 10:01:18,856 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:01:18,862 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=45df39f100180268fd878098f47565eb, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:18,862 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2fb88af62f7dc823bab0d94734f5bf08, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:18,863 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772078862"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772078862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772078862"}]},"ts":"1694772078862"} 2023-09-15 10:01:18,863 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772078862"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772078862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772078862"}]},"ts":"1694772078862"} 2023-09-15 10:01:18,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 45df39f100180268fd878098f47565eb, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:18,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 2fb88af62f7dc823bab0d94734f5bf08, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:18,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 10:01:19,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fb88af62f7dc823bab0d94734f5bf08, NAME => 'testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 10:01:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45df39f100180268fd878098f47565eb, NAME => 'testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 10:01:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. service=AccessControlService 2023-09-15 10:01:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. service=AccessControlService 2023-09-15 10:01:19,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:19,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:19,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:19,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,031 INFO [StoreOpener-2fb88af62f7dc823bab0d94734f5bf08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,031 INFO [StoreOpener-45df39f100180268fd878098f47565eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,032 DEBUG [StoreOpener-2fb88af62f7dc823bab0d94734f5bf08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf 2023-09-15 10:01:19,033 DEBUG [StoreOpener-45df39f100180268fd878098f47565eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf 2023-09-15 10:01:19,033 DEBUG [StoreOpener-45df39f100180268fd878098f47565eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf 2023-09-15 10:01:19,033 DEBUG [StoreOpener-2fb88af62f7dc823bab0d94734f5bf08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf 2023-09-15 10:01:19,033 INFO [StoreOpener-45df39f100180268fd878098f47565eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45df39f100180268fd878098f47565eb columnFamilyName cf 2023-09-15 10:01:19,033 INFO [StoreOpener-2fb88af62f7dc823bab0d94734f5bf08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fb88af62f7dc823bab0d94734f5bf08 columnFamilyName cf 2023-09-15 10:01:19,034 INFO [StoreOpener-2fb88af62f7dc823bab0d94734f5bf08-1] regionserver.HStore(310): Store=2fb88af62f7dc823bab0d94734f5bf08/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:19,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,036 INFO [StoreOpener-45df39f100180268fd878098f47565eb-1] regionserver.HStore(310): Store=45df39f100180268fd878098f47565eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:19,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:19,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:19,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 45df39f100180268fd878098f47565eb 2023-09-15 10:01:19,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 2fb88af62f7dc823bab0d94734f5bf08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60485750, jitterRate=-0.09869208931922913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:19,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 2fb88af62f7dc823bab0d94734f5bf08: 2023-09-15 10:01:19,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08., pid=94, masterSystemTime=1694772079020 2023-09-15 10:01:19,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:19,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 45df39f100180268fd878098f47565eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73774576, jitterRate=0.09932684898376465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:19,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 45df39f100180268fd878098f47565eb: 2023-09-15 10:01:19,042 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2fb88af62f7dc823bab0d94734f5bf08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,042 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772079042"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772079042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772079042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772079042"}]},"ts":"1694772079042"} 2023-09-15 10:01:19,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb., pid=93, masterSystemTime=1694772079020 2023-09-15 10:01:19,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,043 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=45df39f100180268fd878098f47565eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,043 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772079043"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772079043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772079043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772079043"}]},"ts":"1694772079043"} 2023-09-15 10:01:19,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-15 10:01:19,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 2fb88af62f7dc823bab0d94734f5bf08, server=jenkins-hbase17.apache.org,46549,1694771995795 in 175 msec 2023-09-15 10:01:19,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, ASSIGN in 342 msec 2023-09-15 10:01:19,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-15 10:01:19,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 45df39f100180268fd878098f47565eb, server=jenkins-hbase17.apache.org,35307,1694771995748 in 176 msec 2023-09-15 10:01:19,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-15 10:01:19,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, ASSIGN in 343 msec 2023-09-15 10:01:19,047 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:01:19,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772079047"}]},"ts":"1694772079047"} 2023-09-15 10:01:19,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-15 10:01:19,050 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:01:19,050 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-15 10:01:19,051 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 10:01:19,052 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:19,052 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:19,052 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:19,052 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:19,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:19,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:19,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:19,053 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:19,055 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 393 msec 2023-09-15 10:01:19,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-15 10:01:19,273 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-15 10:01:19,278 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:19,279 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,282 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:01:19,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:01:19,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772079299 (current time:1694772079299). 2023-09-15 10:01:19,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:19,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x59041560 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@211d802c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:19,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:19,311 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59041560 to 127.0.0.1:62768 2023-09-15 10:01:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:19,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x09402b6e to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:19,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70168033, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:19,321 DEBUG [hconnection-0x3dc772fd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:19,324 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:19,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:19,330 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:19,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09402b6e to 127.0.0.1:62768 2023-09-15 10:01:19,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:19,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 10:01:19,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:19,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:01:19,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:01:19,336 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:01:19,336 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694772679336 2023-09-15 10:01:19,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:01:19,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:19,338 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:19,338 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:19,339 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:01:19,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 10:01:19,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-15 10:01:19,343 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 10:01:19,344 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694772679344 2023-09-15 10:01:19,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,352 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-15 10:01:19,352 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,353 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-15 10:01:19,353 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-15 10:01:19,354 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,354 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,356 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,356 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,356 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,356 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,356 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,356 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,357 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,357 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 10:01:19,357 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 10:01:19,357 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,359 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 10:01:19,359 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 10:01:19,357 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,359 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,359 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 10:01:19,361 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 10:01:19,360 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 10:01:19,361 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 10:01:19,361 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 10:01:19,361 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 10:01:19,361 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 10:01:19,361 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 10:01:19,362 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,362 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,362 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,362 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,365 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:19,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8d9c8ae[Count = 1] remaining members to acquire global barrier 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 10:01:19,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8d9c8ae[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:19,369 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 10:01:19,369 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,370 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:01:19,370 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:01:19,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,370 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:01:19,370 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 10:01:19,371 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,371 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:19,371 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:19,371 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 10:01:19,371 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,371 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 10:01:19,371 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:19,372 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:19,372 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,372 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. started... 2023-09-15 10:01:19,372 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fb88af62f7dc823bab0d94734f5bf08: 2023-09-15 10:01:19,372 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,372 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:19,372 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:01:19,373 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:19,374 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:19,374 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,374 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. started... 2023-09-15 10:01:19,376 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45df39f100180268fd878098f47565eb: 2023-09-15 10:01:19,376 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,376 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:19,376 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:01:19,385 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. completed. 2023-09-15 10:01:19,385 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:19,385 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. completed. 2023-09-15 10:01:19,385 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:19,385 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:19,386 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 10:01:19,386 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,386 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 10:01:19,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,386 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,386 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,386 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,388 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 10:01:19,387 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 10:01:19,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:01:19,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 10:01:19,394 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-15 10:01:19,394 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:19,394 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:19,394 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,395 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:19,395 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,395 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,396 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,395 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,396 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,397 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,398 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,398 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,398 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,400 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,400 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,400 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:19,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,401 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,401 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:01:19,402 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,402 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,403 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 10:01:19,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-15 10:01:19,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,432 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,432 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694772079336Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694772079408 (+72 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694772079408Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694772079409 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694772079412 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694772079425 (+13 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694772079431 (+6 ms) 2023-09-15 10:01:19,436 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 10:01:19,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 99 msec 2023-09-15 10:01:19,438 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:19,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:01:19,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:19,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46549] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:01:19,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35307] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:01:19,446 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:19,446 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,446 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:01:19,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:01:19,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772079460 (current time:1694772079460). 2023-09-15 10:01:19,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:19,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x6e7b6a0b to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:19,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68adada3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:19,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:19,473 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:19,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e7b6a0b to 127.0.0.1:62768 2023-09-15 10:01:19,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:19,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x7a0fd669 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:19,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f91d011, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:19,486 DEBUG [hconnection-0x4ad4acf5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:19,487 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:19,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:19,494 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:19,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a0fd669 to 127.0.0.1:62768 2023-09-15 10:01:19,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:19,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-15 10:01:19,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:19,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:01:19,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:01:19,499 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:01:19,500 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694772679500 2023-09-15 10:01:19,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-15 10:01:19,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:19,502 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:19,502 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:19,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 10:01:19,503 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-15 10:01:19,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-15 10:01:19,506 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 10:01:19,506 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694772679506 2023-09-15 10:01:19,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,515 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-15 10:01:19,515 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,516 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-15 10:01:19,516 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-15 10:01:19,517 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,517 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,518 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,518 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,518 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,518 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,518 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,518 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,518 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,518 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:19,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,519 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 10:01:19,519 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 10:01:19,519 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,519 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-15 10:01:19,520 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 10:01:19,520 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,519 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:19,521 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 10:01:19,524 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-15 10:01:19,524 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 10:01:19,521 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 10:01:19,524 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 10:01:19,524 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 10:01:19,524 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-15 10:01:19,524 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-15 10:01:19,525 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,525 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,526 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,526 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,526 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,527 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:19,526 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,527 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,527 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,527 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,527 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21e3d8b9[Count = 1] remaining members to acquire global barrier 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-15 10:01:19,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21e3d8b9[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:19,530 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-15 10:01:19,530 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,530 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,530 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,530 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,531 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:01:19,531 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,531 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:01:19,531 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-15 10:01:19,531 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 10:01:19,531 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:19,531 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,531 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:19,532 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 10:01:19,532 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,532 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 10:01:19,532 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:19,533 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,533 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:19,533 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. started... 2023-09-15 10:01:19,533 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:19,533 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:19,533 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,533 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. started... 2023-09-15 10:01:19,533 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45df39f100180268fd878098f47565eb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-15 10:01:19,534 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2fb88af62f7dc823bab0d94734f5bf08 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-15 10:01:19,553 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230915c2397ac577294332b26fc89d654b5a08 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915c2397ac577294332b26fc89d654b5a08 2023-09-15 10:01:19,555 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230915cb869df571fb4b0f8a10a303cbd30506 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb869df571fb4b0f8a10a303cbd30506 2023-09-15 10:01:19,561 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/.tmp/cf/8b53d1b3ae094b3584fb57d07bc7a7bc 2023-09-15 10:01:19,567 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/.tmp/cf/8b53d1b3ae094b3584fb57d07bc7a7bc as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf/8b53d1b3ae094b3584fb57d07bc7a7bc 2023-09-15 10:01:19,567 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/.tmp/cf/b40fa0aa614b46eab40fa3b3c08ab627 2023-09-15 10:01:19,571 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf/8b53d1b3ae094b3584fb57d07bc7a7bc, entries=3, sequenceid=6, filesize=5.4 K 2023-09-15 10:01:19,572 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/.tmp/cf/b40fa0aa614b46eab40fa3b3c08ab627 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf/b40fa0aa614b46eab40fa3b3c08ab627 2023-09-15 10:01:19,572 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2fb88af62f7dc823bab0d94734f5bf08 in 38ms, sequenceid=6, compaction requested=false 2023-09-15 10:01:19,572 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-15 10:01:19,572 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fb88af62f7dc823bab0d94734f5bf08: 2023-09-15 10:01:19,572 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,573 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:19,573 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf/8b53d1b3ae094b3584fb57d07bc7a7bc] hfiles 2023-09-15 10:01:19,573 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf/8b53d1b3ae094b3584fb57d07bc7a7bc for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,577 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf/b40fa0aa614b46eab40fa3b3c08ab627, entries=47, sequenceid=6, filesize=13.1 K 2023-09-15 10:01:19,578 INFO [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 45df39f100180268fd878098f47565eb in 45ms, sequenceid=6, compaction requested=false 2023-09-15 10:01:19,582 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45df39f100180268fd878098f47565eb: 2023-09-15 10:01:19,582 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,583 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:19,584 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf/b40fa0aa614b46eab40fa3b3c08ab627] hfiles 2023-09-15 10:01:19,584 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf/b40fa0aa614b46eab40fa3b3c08ab627 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,586 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. completed. 2023-09-15 10:01:19,586 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:19,586 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:19,586 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:19,586 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,586 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 10:01:19,586 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:19,587 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,587 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 10:01:19,587 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,587 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 10:01:19,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,591 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. completed. 2023-09-15 10:01:19,591 DEBUG [rs(jenkins-hbase17.apache.org,35307,1694771995748)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:19,591 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:19,591 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:19,592 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,592 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-15 10:01:19,592 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:19,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:19,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-15 10:01:19,593 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,593 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-15 10:01:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,593 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,593 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-15 10:01:19,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35307,1694771995748': 2023-09-15 10:01:19,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-15 10:01:19,597 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-15 10:01:19,597 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:19,597 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:19,597 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,597 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,598 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:19,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,599 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,599 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,600 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:19,600 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,601 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,602 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:19,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,602 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:19,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,603 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:19,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:19,602 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:19,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:01:19,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:01:19,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,604 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:19,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:19,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:01:19,604 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:01:19,604 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,605 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:19,605 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:19,605 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,605 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb869df571fb4b0f8a10a303cbd30506, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915c2397ac577294332b26fc89d654b5a08] mob files 2023-09-15 10:01:19,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb869df571fb4b0f8a10a303cbd30506 2023-09-15 10:01:19,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915c2397ac577294332b26fc89d654b5a08 2023-09-15 10:01:19,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-15 10:01:19,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,633 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694772079500Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694772079612 (+112 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694772079612Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694772079612Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694772079616 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694772079625 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694772079633 (+8 ms) 2023-09-15 10:01:19,638 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-15 10:01:19,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 136 msec 2023-09-15 10:01:19,805 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:19,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-15 10:01:19,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:19,808 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808 2023-09-15 10:01:19,808 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38409, tgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808, rawTgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:01:19,830 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:01:19,830 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-133047095_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,831 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-15 10:01:19,835 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:19,851 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:19,852 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:19,852 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:19,853 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,566 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-8157428046790504586.jar 2023-09-15 10:01:20,567 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,567 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,621 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-6396779226890355411.jar 2023-09-15 10:01:20,621 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,621 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,622 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,622 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,622 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,622 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:20,623 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:01:20,623 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:01:20,623 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:01:20,623 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:01:20,624 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:01:20,624 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:01:20,624 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:01:20,625 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:01:20,625 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:01:20,625 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:01:20,626 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:20,626 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:20,626 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:20,626 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:20,627 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:20,627 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:20,627 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:20,972 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:01:20,974 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-15 10:01:22,111 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:01:22,111 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:01:22,113 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0005_000001 (auth:SIMPLE) 2023-09-15 10:01:22,915 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0006_000001 (auth:SIMPLE) 2023-09-15 10:01:23,488 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:01:26,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0006_000001 (auth:SIMPLE) 2023-09-15 10:01:29,336 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:01:29,337 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:01:29,344 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:29,344 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:01:29,344 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:01:29,344 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:29,345 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-15 10:01:29,345 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-15 10:01:29,345 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:29,345 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-15 10:01:29,345 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772079808/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-15 10:01:29,349 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,350 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 10:01:29,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772089353"}]},"ts":"1694772089353"} 2023-09-15 10:01:29,354 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-15 10:01:29,355 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-15 10:01:29,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, UNASSIGN}] 2023-09-15 10:01:29,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, UNASSIGN 2023-09-15 10:01:29,358 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, UNASSIGN 2023-09-15 10:01:29,359 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=45df39f100180268fd878098f47565eb, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:29,359 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2fb88af62f7dc823bab0d94734f5bf08, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:29,359 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772089359"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772089359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772089359"}]},"ts":"1694772089359"} 2023-09-15 10:01:29,359 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772089359"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772089359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772089359"}]},"ts":"1694772089359"} 2023-09-15 10:01:29,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 45df39f100180268fd878098f47565eb, server=jenkins-hbase17.apache.org,35307,1694771995748}] 2023-09-15 10:01:29,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 2fb88af62f7dc823bab0d94734f5bf08, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:29,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 10:01:29,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 45df39f100180268fd878098f47565eb 2023-09-15 10:01:29,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 45df39f100180268fd878098f47565eb, disabling compactions & flushes 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 2fb88af62f7dc823bab0d94734f5bf08, disabling compactions & flushes 2023-09-15 10:01:29,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:29,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. after waiting 0 ms 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. after waiting 0 ms 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:29,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:29,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:29,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:29,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:29,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:29,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb. 2023-09-15 10:01:29,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 45df39f100180268fd878098f47565eb: 2023-09-15 10:01:29,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08. 2023-09-15 10:01:29,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 2fb88af62f7dc823bab0d94734f5bf08: 2023-09-15 10:01:29,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:29,526 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2fb88af62f7dc823bab0d94734f5bf08, regionState=CLOSED 2023-09-15 10:01:29,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772089526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772089526"}]},"ts":"1694772089526"} 2023-09-15 10:01:29,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 45df39f100180268fd878098f47565eb 2023-09-15 10:01:29,526 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=45df39f100180268fd878098f47565eb, regionState=CLOSED 2023-09-15 10:01:29,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694772089526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772089526"}]},"ts":"1694772089526"} 2023-09-15 10:01:29,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-15 10:01:29,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 2fb88af62f7dc823bab0d94734f5bf08, server=jenkins-hbase17.apache.org,46549,1694771995795 in 166 msec 2023-09-15 10:01:29,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-15 10:01:29,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 45df39f100180268fd878098f47565eb, server=jenkins-hbase17.apache.org,35307,1694771995748 in 167 msec 2023-09-15 10:01:29,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2fb88af62f7dc823bab0d94734f5bf08, UNASSIGN in 172 msec 2023-09-15 10:01:29,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-15 10:01:29,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45df39f100180268fd878098f47565eb, UNASSIGN in 173 msec 2023-09-15 10:01:29,530 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772089530"}]},"ts":"1694772089530"} 2023-09-15 10:01:29,531 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-15 10:01:29,532 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-15 10:01:29,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 182 msec 2023-09-15 10:01:29,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-15 10:01:29,658 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-15 10:01:29,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,666 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,669 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,671 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,671 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,671 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,671 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 10:01:29,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 10:01:29,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 10:01:29,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,673 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,673 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:29,673 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:29,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-15 10:01:29,676 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/recovered.edits] 2023-09-15 10:01:29,676 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/recovered.edits] 2023-09-15 10:01:29,679 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf/8b53d1b3ae094b3584fb57d07bc7a7bc to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/cf/8b53d1b3ae094b3584fb57d07bc7a7bc 2023-09-15 10:01:29,679 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf/b40fa0aa614b46eab40fa3b3c08ab627 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/cf/b40fa0aa614b46eab40fa3b3c08ab627 2023-09-15 10:01:29,682 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08/recovered.edits/9.seqid 2023-09-15 10:01:29,682 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb/recovered.edits/9.seqid 2023-09-15 10:01:29,682 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/2fb88af62f7dc823bab0d94734f5bf08 2023-09-15 10:01:29,682 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testEmptyExportFileSystemState/45df39f100180268fd878098f47565eb 2023-09-15 10:01:29,682 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-15 10:01:29,682 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-15 10:01:29,683 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-15 10:01:29,685 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb869df571fb4b0f8a10a303cbd30506 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230915cb869df571fb4b0f8a10a303cbd30506 2023-09-15 10:01:29,686 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915c2397ac577294332b26fc89d654b5a08 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230915c2397ac577294332b26fc89d654b5a08 2023-09-15 10:01:29,686 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-15 10:01:29,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,689 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-15 10:01:29,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-15 10:01:29,694 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,694 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-15 10:01:29,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772089694"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:29,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772089694"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:29,696 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 10:01:29,696 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2fb88af62f7dc823bab0d94734f5bf08, NAME => 'testtb-testEmptyExportFileSystemState,,1694772078660.2fb88af62f7dc823bab0d94734f5bf08.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 45df39f100180268fd878098f47565eb, NAME => 'testtb-testEmptyExportFileSystemState,1,1694772078660.45df39f100180268fd878098f47565eb.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 10:01:29,696 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-15 10:01:29,696 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772089696"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:29,698 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-15 10:01:29,700 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-15 10:01:29,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-15 10:01:29,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-15 10:01:29,777 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-15 10:01:29,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-15 10:01:29,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:29,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-15 10:01:29,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-15 10:01:29,824 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 762) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:42392 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4726 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:41939 from appattempt_1694772001969_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:45431 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:54138 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1791148351_17 at /127.0.0.1:55896 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_863805086_1 at /127.0.0.1:55844 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3d8804f9-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_863805086_1 at /127.0.0.1:54120 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1275937654) connection to jenkins-hbase17.apache.org/136.243.18.41:40793 from appattempt_1694772001969_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=944 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 210) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9216 (was 9315) 2023-09-15 10:01:29,824 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-15 10:01:29,840 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=944, MaxFileDescriptor=60000, SystemLoadAverage=217, ProcessCount=167, AvailableMemoryMB=9215 2023-09-15 10:01:29,841 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-15 10:01:29,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-15 10:01:29,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:29,845 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-15 10:01:29,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-15 10:01:29,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-15 10:01:29,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 10:01:29,847 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:29,847 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:29,848 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 empty. 2023-09-15 10:01:29,848 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d empty. 2023-09-15 10:01:29,848 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:29,848 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:29,848 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-15 10:01:29,857 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-15 10:01:29,858 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a52ea176c99ba303057a2e9cb5b0858d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:29,858 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 83090a2cbd4e140ce08d0a23e45846d6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp 2023-09-15 10:01:29,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:29,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a52ea176c99ba303057a2e9cb5b0858d, disabling compactions & flushes 2023-09-15 10:01:29,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:29,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:29,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. after waiting 0 ms 2023-09-15 10:01:29,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:29,873 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:29,873 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a52ea176c99ba303057a2e9cb5b0858d: 2023-09-15 10:01:29,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:29,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 83090a2cbd4e140ce08d0a23e45846d6, disabling compactions & flushes 2023-09-15 10:01:29,881 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:29,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:29,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. after waiting 0 ms 2023-09-15 10:01:29,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:29,881 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:29,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 83090a2cbd4e140ce08d0a23e45846d6: 2023-09-15 10:01:29,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-15 10:01:29,884 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772089884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772089884"}]},"ts":"1694772089884"} 2023-09-15 10:01:29,884 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772089884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772089884"}]},"ts":"1694772089884"} 2023-09-15 10:01:29,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-15 10:01:29,887 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-15 10:01:29,887 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772089887"}]},"ts":"1694772089887"} 2023-09-15 10:01:29,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-15 10:01:29,890 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-09-15 10:01:29,891 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-15 10:01:29,891 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-15 10:01:29,891 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-15 10:01:29,891 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-15 10:01:29,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, ASSIGN}] 2023-09-15 10:01:29,894 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, ASSIGN 2023-09-15 10:01:29,894 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, ASSIGN 2023-09-15 10:01:29,894 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,34885,1694771995831; forceNewPlan=false, retain=false 2023-09-15 10:01:29,894 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,46549,1694771995795; forceNewPlan=false, retain=false 2023-09-15 10:01:29,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 10:01:30,045 INFO [jenkins-hbase17:34365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-15 10:01:30,047 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=83090a2cbd4e140ce08d0a23e45846d6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,047 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a52ea176c99ba303057a2e9cb5b0858d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,047 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772090047"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772090047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772090047"}]},"ts":"1694772090047"} 2023-09-15 10:01:30,047 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772090047"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772090047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772090047"}]},"ts":"1694772090047"} 2023-09-15 10:01:30,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 83090a2cbd4e140ce08d0a23e45846d6, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 10:01:30,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure a52ea176c99ba303057a2e9cb5b0858d, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:30,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 10:01:30,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83090a2cbd4e140ce08d0a23e45846d6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.', STARTKEY => '1', ENDKEY => ''} 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. service=AccessControlService 2023-09-15 10:01:30,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a52ea176c99ba303057a2e9cb5b0858d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.', STARTKEY => '', ENDKEY => '1'} 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. service=AccessControlService 2023-09-15 10:01:30,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-15 10:01:30,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-15 10:01:30,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,208 INFO [StoreOpener-83090a2cbd4e140ce08d0a23e45846d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,208 INFO [StoreOpener-a52ea176c99ba303057a2e9cb5b0858d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,210 DEBUG [StoreOpener-83090a2cbd4e140ce08d0a23e45846d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf 2023-09-15 10:01:30,210 DEBUG [StoreOpener-83090a2cbd4e140ce08d0a23e45846d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf 2023-09-15 10:01:30,210 DEBUG [StoreOpener-a52ea176c99ba303057a2e9cb5b0858d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf 2023-09-15 10:01:30,210 DEBUG [StoreOpener-a52ea176c99ba303057a2e9cb5b0858d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf 2023-09-15 10:01:30,210 INFO [StoreOpener-83090a2cbd4e140ce08d0a23e45846d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83090a2cbd4e140ce08d0a23e45846d6 columnFamilyName cf 2023-09-15 10:01:30,211 INFO [StoreOpener-a52ea176c99ba303057a2e9cb5b0858d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a52ea176c99ba303057a2e9cb5b0858d columnFamilyName cf 2023-09-15 10:01:30,212 INFO [StoreOpener-a52ea176c99ba303057a2e9cb5b0858d-1] regionserver.HStore(310): Store=a52ea176c99ba303057a2e9cb5b0858d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:30,212 INFO [StoreOpener-83090a2cbd4e140ce08d0a23e45846d6-1] regionserver.HStore(310): Store=83090a2cbd4e140ce08d0a23e45846d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-15 10:01:30,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:30,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:30,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:30,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-15 10:01:30,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a52ea176c99ba303057a2e9cb5b0858d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75296578, jitterRate=0.12200644612312317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:30,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 83090a2cbd4e140ce08d0a23e45846d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64834917, jitterRate=-0.033884450793266296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-15 10:01:30,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a52ea176c99ba303057a2e9cb5b0858d: 2023-09-15 10:01:30,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 83090a2cbd4e140ce08d0a23e45846d6: 2023-09-15 10:01:30,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d., pid=109, masterSystemTime=1694772090201 2023-09-15 10:01:30,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6., pid=108, masterSystemTime=1694772090200 2023-09-15 10:01:30,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=83090a2cbd4e140ce08d0a23e45846d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,221 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772090221"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772090221"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772090221"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772090221"}]},"ts":"1694772090221"} 2023-09-15 10:01:30,221 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a52ea176c99ba303057a2e9cb5b0858d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,222 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772090221"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694772090221"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694772090221"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694772090221"}]},"ts":"1694772090221"} 2023-09-15 10:01:30,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-15 10:01:30,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 83090a2cbd4e140ce08d0a23e45846d6, server=jenkins-hbase17.apache.org,34885,1694771995831 in 174 msec 2023-09-15 10:01:30,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-15 10:01:30,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure a52ea176c99ba303057a2e9cb5b0858d, server=jenkins-hbase17.apache.org,46549,1694771995795 in 173 msec 2023-09-15 10:01:30,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, ASSIGN in 334 msec 2023-09-15 10:01:30,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-15 10:01:30,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, ASSIGN in 334 msec 2023-09-15 10:01:30,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-15 10:01:30,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772090227"}]},"ts":"1694772090227"} 2023-09-15 10:01:30,228 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-15 10:01:30,230 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-15 10:01:30,230 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-15 10:01:30,232 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 10:01:30,233 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:30,233 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:30,233 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:30,233 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:30,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:30,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:30,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:30,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-15 10:01:30,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 392 msec 2023-09-15 10:01:30,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-15 10:01:30,453 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-15 10:01:30,459 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,459 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,461 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:01:30,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 10:01:30,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772090477 (current time:1694772090477). 2023-09-15 10:01:30,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:30,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x7b7b4967 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:30,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1809bf76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:30,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:30,493 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:30,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b7b4967 to 127.0.0.1:62768 2023-09-15 10:01:30,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:30,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x436bcf0f to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:30,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627a9674, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:30,506 DEBUG [hconnection-0x37dd7742-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:30,510 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:30,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:30,517 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:30,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x436bcf0f to 127.0.0.1:62768 2023-09-15 10:01:30,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:30,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 10:01:30,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:30,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 10:01:30,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 10:01:30,522 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 10:01:30,522 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694772690522 2023-09-15 10:01:30,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 10:01:30,524 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:30,524 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:30,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 10:01:30,525 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 10:01:30,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-15 10:01:30,527 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 10:01:30,527 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694772690527 2023-09-15 10:01:30,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,535 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-15 10:01:30,535 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,537 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-15 10:01:30,537 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-15 10:01:30,537 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,537 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,539 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,539 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,539 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,539 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,539 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,540 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 10:01:30,540 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 10:01:30,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,541 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 10:01:30,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,541 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,541 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 10:01:30,542 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 10:01:30,542 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 10:01:30,542 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 10:01:30,542 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,542 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,543 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 10:01:30,543 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 10:01:30,542 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 10:01:30,543 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 10:01:30,543 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 10:01:30,543 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 10:01:30,543 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 10:01:30,544 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,544 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,544 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,544 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,544 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,544 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,544 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,545 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:30,544 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,545 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,545 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f59b3a3[Count = 1] remaining members to acquire global barrier 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 10:01:30,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f59b3a3[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:30,548 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-15 10:01:30,548 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,548 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,548 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,548 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,549 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 10:01:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:30,549 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,549 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,549 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:30,549 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. started... 2023-09-15 10:01:30,549 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. started... 2023-09-15 10:01:30,549 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,549 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a52ea176c99ba303057a2e9cb5b0858d: 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83090a2cbd4e140ce08d0a23e45846d6: 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:01:30,551 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-15 10:01:30,551 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 10:01:30,551 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,551 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 10:01:30,561 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. completed. 2023-09-15 10:01:30,561 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. completed. 2023-09-15 10:01:30,561 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,561 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,561 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:30,561 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:30,561 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 10:01:30,562 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:30,563 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,563 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 10:01:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,563 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,563 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 10:01:30,565 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,563 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 10:01:30,565 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 10:01:30,563 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,34885,1694771995831': 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:30,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-15 10:01:30,572 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-15 10:01:30,572 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:30,572 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:30,572 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,572 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:30,573 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,573 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,573 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,573 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,573 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,574 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,574 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,575 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,576 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,576 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,576 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,578 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,579 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,578 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,578 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:01:30,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,579 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,579 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,579 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,579 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-15 10:01:30,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-15 10:01:30,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,611 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694772090522Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694772090591 (+69 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694772090591Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694772090591Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694772090594 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694772090605 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694772090611 (+6 ms) 2023-09-15 10:01:30,613 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 10:01:30,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 90 msec 2023-09-15 10:01:30,624 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:30,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 10:01:30,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:30,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46549] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:01:30,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-15 10:01:30,630 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,630 DEBUG [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,631 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-15 10:01:30,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 10:01:30,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694772090639 (current time:1694772090639). 2023-09-15 10:01:30,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-15 10:01:30,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x17e79fdd to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:30,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bdc9d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:30,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:30,647 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:30,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17e79fdd to 127.0.0.1:62768 2023-09-15 10:01:30,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:30,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(139): Connect 0x23236889 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-15 10:01:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8111247, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-15 10:01:30,656 DEBUG [hconnection-0x278a8afc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:30,664 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:54748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:30,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-15 10:01:30,670 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:42948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-15 10:01:30,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23236889 to 127.0.0.1:62768 2023-09-15 10:01:30,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:01:30,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-15 10:01:30,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-15 10:01:30,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 10:01:30,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 10:01:30,675 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 10:01:30,675 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694772690675 2023-09-15 10:01:30,675 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-15 10:01:30,677 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-15 10:01:30,677 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-15 10:01:30,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 10:01:30,678 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-15 10:01:30,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-15 10:01:30,681 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 10:01:30,681 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694772690681 2023-09-15 10:01:30,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,693 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-15 10:01:30,693 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,694 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-15 10:01:30,694 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-15 10:01:30,695 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,695 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,696 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,696 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,696 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,696 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,696 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,696 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,698 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 10:01:30,698 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 10:01:30,698 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,699 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 10:01:30,699 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,699 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 10:01:30,700 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 10:01:30,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-15 10:01:30,700 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 10:01:30,700 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 10:01:30,700 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 10:01:30,700 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35307,1694771995748' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 10:01:30,701 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,701 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-15 10:01:30,701 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-15 10:01:30,702 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-15 10:01:30,702 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-15 10:01:30,702 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-15 10:01:30,702 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,703 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,703 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,703 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,703 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:30,707 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,707 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:30,708 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,708 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,709 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,709 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-15 10:01:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,46549,1694771995795' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ee04feb[Count = 1] remaining members to acquire global barrier 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,34885,1694771995831' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-15 10:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ee04feb[Count = 0] remaining members to acquire global barrier 2023-09-15 10:01:30,712 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-15 10:01:30,712 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,712 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 10:01:30,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,713 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:30,713 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 10:01:30,713 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. started... 2023-09-15 10:01:30,713 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,713 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-15 10:01:30,713 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-15 10:01:30,713 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. started... 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-15 10:01:30,713 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a52ea176c99ba303057a2e9cb5b0858d 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 10:01:30,713 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35307,1694771995748' in zk 2023-09-15 10:01:30,713 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83090a2cbd4e140ce08d0a23e45846d6 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-15 10:01:30,714 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 10:01:30,714 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,714 DEBUG [member: 'jenkins-hbase17.apache.org,35307,1694771995748' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 10:01:30,729 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309158494f54455a14782b8bdb5f4a61ce728 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309158494f54455a14782b8bdb5f4a61ce728 2023-09-15 10:01:30,729 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309156b620e6a1b7a4868be5b40908f81cf6e to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309156b620e6a1b7a4868be5b40908f81cf6e 2023-09-15 10:01:30,736 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/.tmp/cf/fec4498f04f14e05951b907a43adc6f9 2023-09-15 10:01:30,736 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/.tmp/cf/a44559ba77a448759f7874bd15e8cb90 2023-09-15 10:01:30,740 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/.tmp/cf/fec4498f04f14e05951b907a43adc6f9 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf/fec4498f04f14e05951b907a43adc6f9 2023-09-15 10:01:30,740 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/.tmp/cf/a44559ba77a448759f7874bd15e8cb90 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf/a44559ba77a448759f7874bd15e8cb90 2023-09-15 10:01:30,745 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf/fec4498f04f14e05951b907a43adc6f9, entries=5, sequenceid=6, filesize=5.8 K 2023-09-15 10:01:30,745 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf/a44559ba77a448759f7874bd15e8cb90, entries=45, sequenceid=6, filesize=13.0 K 2023-09-15 10:01:30,746 INFO [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a52ea176c99ba303057a2e9cb5b0858d in 33ms, sequenceid=6, compaction requested=false 2023-09-15 10:01:30,746 INFO [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 83090a2cbd4e140ce08d0a23e45846d6 in 33ms, sequenceid=6, compaction requested=false 2023-09-15 10:01:30,746 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-15 10:01:30,746 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-15 10:01:30,749 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a52ea176c99ba303057a2e9cb5b0858d: 2023-09-15 10:01:30,749 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83090a2cbd4e140ce08d0a23e45846d6: 2023-09-15 10:01:30,749 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,749 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:30,749 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,749 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf/fec4498f04f14e05951b907a43adc6f9] hfiles 2023-09-15 10:01:30,750 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-15 10:01:30,750 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf/fec4498f04f14e05951b907a43adc6f9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,750 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf/a44559ba77a448759f7874bd15e8cb90] hfiles 2023-09-15 10:01:30,750 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf/a44559ba77a448759f7874bd15e8cb90 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,762 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. completed. 2023-09-15 10:01:30,762 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. completed. 2023-09-15 10:01:30,762 DEBUG [rs(jenkins-hbase17.apache.org,46549,1694771995795)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:30,762 DEBUG [rs(jenkins-hbase17.apache.org,34885,1694771995831)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,762 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 10:01:30,763 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-15 10:01:30,763 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,46549,1694771995795' in zk 2023-09-15 10:01:30,763 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,34885,1694771995831' in zk 2023-09-15 10:01:30,763 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,763 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 10:01:30,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,763 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,764 DEBUG [member: 'jenkins-hbase17.apache.org,34885,1694771995831' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 10:01:30,765 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,765 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-15 10:01:30,765 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,765 DEBUG [member: 'jenkins-hbase17.apache.org,46549,1694771995795' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-15 10:01:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,34885,1694771995831': 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,34885,1694771995831' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,46549,1694771995795': 2023-09-15 10:01:30,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,46549,1694771995795' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-15 10:01:30,771 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-15 10:01:30,771 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-15 10:01:30,771 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-15 10:01:30,771 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,771 INFO [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-15 10:01:30,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,772 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,772 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-15 10:01:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,773 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,773 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-15 10:01:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,774 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-15 10:01:30,775 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,775 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,777 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:30,777 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,777 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,777 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,777 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,777 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-15 10:01:30,777 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,778 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-15 10:01:30,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,778 DEBUG [(jenkins-hbase17.apache.org,34365,1694771994680)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-15 10:01:30,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-15 10:01:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 10:01:30,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-15 10:01:30,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,778 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-15 10:01:30,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-15 10:01:30,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,780 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:30,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309156b620e6a1b7a4868be5b40908f81cf6e, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309158494f54455a14782b8bdb5f4a61ce728] mob files 2023-09-15 10:01:30,780 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:01:30,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309156b620e6a1b7a4868be5b40908f81cf6e 2023-09-15 10:01:30,781 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309158494f54455a14782b8bdb5f4a61ce728 2023-09-15 10:01:30,781 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-15 10:01:30,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,807 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:30,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694772090675Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694772090789 (+114 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694772090789Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694772090789Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694772090792 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694772090801 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694772090807 (+6 ms) 2023-09-15 10:01:30,809 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-15 10:01:30,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 132 msec 2023-09-15 10:01:30,980 DEBUG [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-15 10:01:30,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-15 10:01:30,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-15 10:01:30,984 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984 2023-09-15 10:01:30,984 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38409, tgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984, rawTgtDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984, srcFsUri=hdfs://localhost:38409, srcDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:01:31,007 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6 2023-09-15 10:01:31,008 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2039921843_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:31,008 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38409, inputRoot=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6, snapshotDir=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-15 10:01:31,014 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:31,028 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,029 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,029 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,029 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,738 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-8448985249202855780.jar 2023-09-15 10:01:31,738 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,739 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,794 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/hadoop-2523659123028692536.jar 2023-09-15 10:01:31,794 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,794 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,795 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,795 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,795 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,796 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-15 10:01:31,796 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-15 10:01:31,796 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-15 10:01:31,797 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-15 10:01:31,797 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-15 10:01:31,797 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-15 10:01:31,798 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-15 10:01:31,798 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-15 10:01:31,798 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-15 10:01:31,798 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-15 10:01:31,799 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-15 10:01:31,799 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:31,800 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:31,800 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:31,800 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:31,800 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-15 10:01:31,801 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:31,801 DEBUG [Listener at jenkins-hbase17.apache.org/42523] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-15 10:01:32,122 WARN [Listener at jenkins-hbase17.apache.org/42523] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-15 10:01:32,124 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-15 10:01:32,127 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-15 10:01:33,651 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:01:33,651 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-15 10:01:33,657 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0006_000001 (auth:SIMPLE) 2023-09-15 10:01:34,130 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0007_000001 (auth:SIMPLE) 2023-09-15 10:01:35,102 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:01:37,523 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0007_000001 (auth:SIMPLE) 2023-09-15 10:01:39,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0007_000001 (auth:SIMPLE) 2023-09-15 10:01:42,413 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0007_000001 (auth:SIMPLE) 2023-09-15 10:01:44,304 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-15 10:01:44,304 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-15 10:01:44,314 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,314 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-15 10:01:44,315 INFO [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-15 10:01:44,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-15 10:01:44,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-15 10:01:44,315 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1791148351_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,316 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-15 10:01:44,316 DEBUG [Listener at jenkins-hbase17.apache.org/42523] snapshot.TestExportSnapshot(367): hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/export-test/export-1694772090984/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-15 10:01:44,322 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 10:01:44,327 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772104326"}]},"ts":"1694772104326"} 2023-09-15 10:01:44,328 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-15 10:01:44,329 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-15 10:01:44,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, UNASSIGN}] 2023-09-15 10:01:44,332 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, UNASSIGN 2023-09-15 10:01:44,332 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, UNASSIGN 2023-09-15 10:01:44,333 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=83090a2cbd4e140ce08d0a23e45846d6, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:01:44,333 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a52ea176c99ba303057a2e9cb5b0858d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:01:44,333 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772104333"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772104333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772104333"}]},"ts":"1694772104333"} 2023-09-15 10:01:44,333 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772104333"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694772104333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694772104333"}]},"ts":"1694772104333"} 2023-09-15 10:01:44,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 83090a2cbd4e140ce08d0a23e45846d6, server=jenkins-hbase17.apache.org,34885,1694771995831}] 2023-09-15 10:01:44,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure a52ea176c99ba303057a2e9cb5b0858d, server=jenkins-hbase17.apache.org,46549,1694771995795}] 2023-09-15 10:01:44,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 10:01:44,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:44,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 83090a2cbd4e140ce08d0a23e45846d6, disabling compactions & flushes 2023-09-15 10:01:44,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:44,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:44,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. after waiting 0 ms 2023-09-15 10:01:44,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:44,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:44,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a52ea176c99ba303057a2e9cb5b0858d, disabling compactions & flushes 2023-09-15 10:01:44,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:44,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:44,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. after waiting 0 ms 2023-09-15 10:01:44,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:44,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:44,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:01:44,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:44,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:01:44,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6. 2023-09-15 10:01:44,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d. 2023-09-15 10:01:44,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 83090a2cbd4e140ce08d0a23e45846d6: 2023-09-15 10:01:44,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a52ea176c99ba303057a2e9cb5b0858d: 2023-09-15 10:01:44,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:44,514 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=83090a2cbd4e140ce08d0a23e45846d6, regionState=CLOSED 2023-09-15 10:01:44,514 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772104514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772104514"}]},"ts":"1694772104514"} 2023-09-15 10:01:44,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:44,515 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a52ea176c99ba303057a2e9cb5b0858d, regionState=CLOSED 2023-09-15 10:01:44,515 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694772104515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694772104515"}]},"ts":"1694772104515"} 2023-09-15 10:01:44,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-15 10:01:44,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 83090a2cbd4e140ce08d0a23e45846d6, server=jenkins-hbase17.apache.org,34885,1694771995831 in 180 msec 2023-09-15 10:01:44,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-15 10:01:44,517 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure a52ea176c99ba303057a2e9cb5b0858d, server=jenkins-hbase17.apache.org,46549,1694771995795 in 180 msec 2023-09-15 10:01:44,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=83090a2cbd4e140ce08d0a23e45846d6, UNASSIGN in 187 msec 2023-09-15 10:01:44,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-15 10:01:44,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a52ea176c99ba303057a2e9cb5b0858d, UNASSIGN in 187 msec 2023-09-15 10:01:44,519 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694772104519"}]},"ts":"1694772104519"} 2023-09-15 10:01:44,520 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-15 10:01:44,521 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-15 10:01:44,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 199 msec 2023-09-15 10:01:44,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-15 10:01:44,631 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-15 10:01:44,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,636 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,637 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,639 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34885] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,641 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,641 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,641 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,642 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 10:01:44,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 10:01:44,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:44,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:44,643 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-15 10:01:44,643 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-15 10:01:44,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-15 10:01:44,645 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:44,645 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:44,647 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/recovered.edits] 2023-09-15 10:01:44,647 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf, FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/recovered.edits] 2023-09-15 10:01:44,650 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf/a44559ba77a448759f7874bd15e8cb90 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/cf/a44559ba77a448759f7874bd15e8cb90 2023-09-15 10:01:44,650 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf/fec4498f04f14e05951b907a43adc6f9 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/cf/fec4498f04f14e05951b907a43adc6f9 2023-09-15 10:01:44,652 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6/recovered.edits/9.seqid 2023-09-15 10:01:44,652 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/recovered.edits/9.seqid to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d/recovered.edits/9.seqid 2023-09-15 10:01:44,653 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/83090a2cbd4e140ce08d0a23e45846d6 2023-09-15 10:01:44,653 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a52ea176c99ba303057a2e9cb5b0858d 2023-09-15 10:01:44,653 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-15 10:01:44,653 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-15 10:01:44,654 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-15 10:01:44,657 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309156b620e6a1b7a4868be5b40908f81cf6e to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309156b620e6a1b7a4868be5b40908f81cf6e 2023-09-15 10:01:44,658 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309158494f54455a14782b8bdb5f4a61ce728 to hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309158494f54455a14782b8bdb5f4a61ce728 2023-09-15 10:01:44,658 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-15 10:01:44,660 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,662 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-15 10:01:44,664 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-15 10:01:44,665 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,665 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-15 10:01:44,665 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772104665"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:44,665 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694772104665"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:44,667 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-15 10:01:44,667 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a52ea176c99ba303057a2e9cb5b0858d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694772089842.a52ea176c99ba303057a2e9cb5b0858d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 83090a2cbd4e140ce08d0a23e45846d6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694772089842.83090a2cbd4e140ce08d0a23e45846d6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-15 10:01:44,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-15 10:01:44,667 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694772104667"}]},"ts":"9223372036854775807"} 2023-09-15 10:01:44,668 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-15 10:01:44,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-09-15 10:01:44,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-15 10:01:44,746 INFO [Listener at jenkins-hbase17.apache.org/42523] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-15 10:01:44,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-15 10:01:44,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-15 10:01:44,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-15 10:01:44,779 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=919 (was 944), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 217) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=9176 (was 9215) 2023-09-15 10:01:44,779 WARN [Listener at jenkins-hbase17.apache.org/42523] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-15 10:01:44,779 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-15 10:01:44,788 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-15 10:01:48,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694772001969_0007_000001 (auth:SIMPLE) 2023-09-15 10:01:50,078 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-15 10:01:58,921 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-15 10:02:13,048 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 10:02:13,049 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-15 10:02:13,163 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-15 10:02:13,173 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-15 10:02:13,174 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 10:02:13,182 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-09-15 10:02:13,287 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-15 10:02:13,287 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-15 10:02:13,287 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-15 10:02:13,287 INFO [Listener at jenkins-hbase17.apache.org/42523] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-15 10:02:13,288 DEBUG [Listener at jenkins-hbase17.apache.org/42523] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x326622aa to 127.0.0.1:62768 2023-09-15 10:02:13,288 DEBUG [Listener at jenkins-hbase17.apache.org/42523] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,288 DEBUG [Listener at jenkins-hbase17.apache.org/42523] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-15 10:02:13,289 DEBUG [Listener at jenkins-hbase17.apache.org/42523] util.JVMClusterUtil(257): Found active master hash=2076813098, stopped=false 2023-09-15 10:02:13,289 DEBUG [Listener at jenkins-hbase17.apache.org/42523] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,289 DEBUG [Listener at jenkins-hbase17.apache.org/42523] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-15 10:02:13,289 INFO [Listener at jenkins-hbase17.apache.org/42523] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 10:02:13,291 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 10:02:13,291 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 10:02:13,291 INFO [Listener at jenkins-hbase17.apache.org/42523] procedure2.ProcedureExecutor(628): Stopping 2023-09-15 10:02:13,291 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 10:02:13,291 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-15 10:02:13,291 DEBUG [Listener at jenkins-hbase17.apache.org/42523] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71b42254 to 127.0.0.1:62768 2023-09-15 10:02:13,291 DEBUG [Listener at jenkins-hbase17.apache.org/42523] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 10:02:13,292 INFO [Listener at jenkins-hbase17.apache.org/42523] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35307,1694771995748' ***** 2023-09-15 10:02:13,291 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 10:02:13,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 10:02:13,292 DEBUG [Listener at jenkins-hbase17.apache.org/42523] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 10:02:13,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-15 10:02:13,292 INFO [Listener at jenkins-hbase17.apache.org/42523] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 10:02:13,292 INFO [Listener at jenkins-hbase17.apache.org/42523] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,46549,1694771995795' ***** 2023-09-15 10:02:13,293 DEBUG [Listener at jenkins-hbase17.apache.org/42523] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,293 INFO [RS:0;jenkins-hbase17:35307] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 10:02:13,293 INFO [Listener at jenkins-hbase17.apache.org/42523] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 10:02:13,293 INFO [Listener at jenkins-hbase17.apache.org/42523] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,34885,1694771995831' ***** 2023-09-15 10:02:13,293 INFO [RS:0;jenkins-hbase17:35307] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 10:02:13,293 INFO [RS:1;jenkins-hbase17:46549] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 10:02:13,293 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 10:02:13,293 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 10:02:13,293 DEBUG [Listener at jenkins-hbase17.apache.org/42523] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,293 INFO [RS:1;jenkins-hbase17:46549] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 10:02:13,293 INFO [RS:0;jenkins-hbase17:35307] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 10:02:13,293 INFO [RS:1;jenkins-hbase17:46549] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 10:02:13,293 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:02:13,293 INFO [Listener at jenkins-hbase17.apache.org/42523] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-15 10:02:13,294 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(3305): Received CLOSE for 21267cebff037eaed659367339c352ce 2023-09-15 10:02:13,294 INFO [RS:2;jenkins-hbase17:34885] regionserver.HeapMemoryManager(220): Stopping 2023-09-15 10:02:13,294 DEBUG [RS:0;jenkins-hbase17:35307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x354f4d9d to 127.0.0.1:62768 2023-09-15 10:02:13,294 DEBUG [RS:0;jenkins-hbase17:35307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,294 INFO [RS:2;jenkins-hbase17:34885] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-15 10:02:13,297 INFO [RS:0;jenkins-hbase17:35307] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 10:02:13,297 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:02:13,294 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-15 10:02:13,297 DEBUG [RS:1;jenkins-hbase17:46549] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36ee0fba to 127.0.0.1:62768 2023-09-15 10:02:13,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 21267cebff037eaed659367339c352ce, disabling compactions & flushes 2023-09-15 10:02:13,297 INFO [RS:0;jenkins-hbase17:35307] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 10:02:13,297 INFO [RS:2;jenkins-hbase17:34885] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-15 10:02:13,298 INFO [RS:0;jenkins-hbase17:35307] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 10:02:13,298 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(3305): Received CLOSE for 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 10:02:13,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 10:02:13,298 DEBUG [RS:1;jenkins-hbase17:46549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 10:02:13,298 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:02:13,298 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-15 10:02:13,299 DEBUG [RS:2;jenkins-hbase17:34885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08ef32fb to 127.0.0.1:62768 2023-09-15 10:02:13,299 DEBUG [RS:2;jenkins-hbase17:34885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. after waiting 0 ms 2023-09-15 10:02:13,299 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-15 10:02:13,299 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 10:02:13,300 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-15 10:02:13,300 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1478): Online Regions={21267cebff037eaed659367339c352ce=hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce.} 2023-09-15 10:02:13,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 5ef49b271892c1fa4f5f16fa971b457d, disabling compactions & flushes 2023-09-15 10:02:13,300 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-15 10:02:13,300 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 10:02:13,300 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-15 10:02:13,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 10:02:13,301 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-15 10:02:13,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 21267cebff037eaed659367339c352ce 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-15 10:02:13,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-15 10:02:13,300 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1478): Online Regions={5ef49b271892c1fa4f5f16fa971b457d=hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d.} 2023-09-15 10:02:13,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 10:02:13,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-15 10:02:13,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 10:02:13,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-15 10:02:13,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-15 10:02:13,301 DEBUG [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1504): Waiting on 21267cebff037eaed659367339c352ce 2023-09-15 10:02:13,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-15 10:02:13,301 DEBUG [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-15 10:02:13,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. after waiting 0 ms 2023-09-15 10:02:13,301 DEBUG [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1504): Waiting on 5ef49b271892c1fa4f5f16fa971b457d 2023-09-15 10:02:13,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 10:02:13,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 5ef49b271892c1fa4f5f16fa971b457d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-15 10:02:13,313 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-15 10:02:13,313 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-15 10:02:13,313 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 10:02:13,313 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 10:02:13,313 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-15 10:02:13,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/.tmp/l/e5d3af60fc5145bea422a4260fa242c8 2023-09-15 10:02:13,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/.tmp/info/c3bad1b9a7134d449ca1e21058385f59 2023-09-15 10:02:13,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/.tmp/info/a1b737a0ba214ebf928734ddc708ed1f 2023-09-15 10:02:13,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5d3af60fc5145bea422a4260fa242c8 2023-09-15 10:02:13,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/.tmp/l/e5d3af60fc5145bea422a4260fa242c8 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/l/e5d3af60fc5145bea422a4260fa242c8 2023-09-15 10:02:13,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/.tmp/info/c3bad1b9a7134d449ca1e21058385f59 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/info/c3bad1b9a7134d449ca1e21058385f59 2023-09-15 10:02:13,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5d3af60fc5145bea422a4260fa242c8 2023-09-15 10:02:13,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/l/e5d3af60fc5145bea422a4260fa242c8, entries=7, sequenceid=18, filesize=5.2 K 2023-09-15 10:02:13,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/info/c3bad1b9a7134d449ca1e21058385f59, entries=2, sequenceid=6, filesize=4.8 K 2023-09-15 10:02:13,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5ef49b271892c1fa4f5f16fa971b457d in 27ms, sequenceid=18, compaction requested=false 2023-09-15 10:02:13,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 21267cebff037eaed659367339c352ce in 30ms, sequenceid=6, compaction requested=false 2023-09-15 10:02:13,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/namespace/21267cebff037eaed659367339c352ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-15 10:02:13,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/acl/5ef49b271892c1fa4f5f16fa971b457d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-15 10:02:13,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 10:02:13,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 10:02:13,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 21267cebff037eaed659367339c352ce: 2023-09-15 10:02:13,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 5ef49b271892c1fa4f5f16fa971b457d: 2023-09-15 10:02:13,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694771998535.5ef49b271892c1fa4f5f16fa971b457d. 2023-09-15 10:02:13,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694771997789.21267cebff037eaed659367339c352ce. 2023-09-15 10:02:13,347 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1b737a0ba214ebf928734ddc708ed1f 2023-09-15 10:02:13,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/.tmp/rep_barrier/3e84714c02a548c889b7e1cc38731d0b 2023-09-15 10:02:13,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e84714c02a548c889b7e1cc38731d0b 2023-09-15 10:02:13,379 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/.tmp/table/0767061a41d64a71998ef7c0bcb38ab8 2023-09-15 10:02:13,383 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0767061a41d64a71998ef7c0bcb38ab8 2023-09-15 10:02:13,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/.tmp/info/a1b737a0ba214ebf928734ddc708ed1f as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/info/a1b737a0ba214ebf928734ddc708ed1f 2023-09-15 10:02:13,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1b737a0ba214ebf928734ddc708ed1f 2023-09-15 10:02:13,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/info/a1b737a0ba214ebf928734ddc708ed1f, entries=48, sequenceid=131, filesize=10.3 K 2023-09-15 10:02:13,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/.tmp/rep_barrier/3e84714c02a548c889b7e1cc38731d0b as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/rep_barrier/3e84714c02a548c889b7e1cc38731d0b 2023-09-15 10:02:13,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3e84714c02a548c889b7e1cc38731d0b 2023-09-15 10:02:13,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/rep_barrier/3e84714c02a548c889b7e1cc38731d0b, entries=13, sequenceid=131, filesize=6.4 K 2023-09-15 10:02:13,395 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/.tmp/table/0767061a41d64a71998ef7c0bcb38ab8 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/table/0767061a41d64a71998ef7c0bcb38ab8 2023-09-15 10:02:13,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0767061a41d64a71998ef7c0bcb38ab8 2023-09-15 10:02:13,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/table/0767061a41d64a71998ef7c0bcb38ab8, entries=24, sequenceid=131, filesize=6.9 K 2023-09-15 10:02:13,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 99ms, sequenceid=131, compaction requested=false 2023-09-15 10:02:13,411 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-15 10:02:13,411 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-15 10:02:13,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-15 10:02:13,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-15 10:02:13,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-15 10:02:13,412 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-15 10:02:13,501 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,46549,1694771995795; all regions closed. 2023-09-15 10:02:13,501 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35307,1694771995748; all regions closed. 2023-09-15 10:02:13,502 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,34885,1694771995831; all regions closed. 2023-09-15 10:02:13,511 DEBUG [RS:2;jenkins-hbase17:34885] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs 2023-09-15 10:02:13,511 DEBUG [RS:1;jenkins-hbase17:46549] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs 2023-09-15 10:02:13,511 DEBUG [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs 2023-09-15 10:02:13,511 INFO [RS:1;jenkins-hbase17:46549] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C46549%2C1694771995795:(num 1694771997395) 2023-09-15 10:02:13,511 INFO [RS:2;jenkins-hbase17:34885] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C34885%2C1694771995831:(num 1694771997396) 2023-09-15 10:02:13,511 DEBUG [RS:1;jenkins-hbase17:46549] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,511 INFO [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35307%2C1694771995748.meta:.meta(num 1694771997501) 2023-09-15 10:02:13,512 INFO [RS:1;jenkins-hbase17:46549] regionserver.LeaseManager(133): Closed leases 2023-09-15 10:02:13,512 DEBUG [RS:2;jenkins-hbase17:34885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,512 INFO [RS:2;jenkins-hbase17:34885] regionserver.LeaseManager(133): Closed leases 2023-09-15 10:02:13,512 INFO [RS:1;jenkins-hbase17:46549] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-15 10:02:13,512 INFO [RS:2;jenkins-hbase17:34885] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-15 10:02:13,513 INFO [RS:2;jenkins-hbase17:34885] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 10:02:13,513 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 10:02:13,513 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 10:02:13,513 INFO [RS:2;jenkins-hbase17:34885] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 10:02:13,513 INFO [RS:1;jenkins-hbase17:46549] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-15 10:02:13,513 INFO [RS:2;jenkins-hbase17:34885] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 10:02:13,513 INFO [RS:1;jenkins-hbase17:46549] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-15 10:02:13,513 INFO [RS:1;jenkins-hbase17:46549] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-15 10:02:13,514 INFO [RS:1;jenkins-hbase17:46549] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:46549 2023-09-15 10:02:13,515 INFO [RS:2;jenkins-hbase17:34885] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:34885 2023-09-15 10:02:13,519 DEBUG [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/oldWALs 2023-09-15 10:02:13,520 INFO [RS:0;jenkins-hbase17:35307] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35307%2C1694771995748:(num 1694771997396) 2023-09-15 10:02:13,520 DEBUG [RS:0;jenkins-hbase17:35307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,520 INFO [RS:0;jenkins-hbase17:35307] regionserver.LeaseManager(133): Closed leases 2023-09-15 10:02:13,520 INFO [RS:0;jenkins-hbase17:35307] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-15 10:02:13,520 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 10:02:13,521 INFO [RS:0;jenkins-hbase17:35307] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35307 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,34885,1694771995831 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,46549,1694771995795 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:02:13,524 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35307,1694771995748 2023-09-15 10:02:13,525 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,35307,1694771995748] 2023-09-15 10:02:13,525 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,35307,1694771995748; numProcessing=1 2023-09-15 10:02:13,526 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,35307,1694771995748 already deleted, retry=false 2023-09-15 10:02:13,526 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,35307,1694771995748 expired; onlineServers=2 2023-09-15 10:02:13,526 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,34885,1694771995831] 2023-09-15 10:02:13,526 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,34885,1694771995831; numProcessing=2 2023-09-15 10:02:13,527 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,34885,1694771995831 already deleted, retry=false 2023-09-15 10:02:13,527 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,34885,1694771995831 expired; onlineServers=1 2023-09-15 10:02:13,527 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,46549,1694771995795] 2023-09-15 10:02:13,527 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,46549,1694771995795; numProcessing=3 2023-09-15 10:02:13,527 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,46549,1694771995795 already deleted, retry=false 2023-09-15 10:02:13,527 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,46549,1694771995795 expired; onlineServers=0 2023-09-15 10:02:13,527 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,34365,1694771994680' ***** 2023-09-15 10:02:13,527 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-15 10:02:13,528 DEBUG [M:0;jenkins-hbase17:34365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3af4ad11, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-09-15 10:02:13,528 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,34365,1694771994680 2023-09-15 10:02:13,528 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,34365,1694771994680; all regions closed. 2023-09-15 10:02:13,528 DEBUG [M:0;jenkins-hbase17:34365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-15 10:02:13,528 DEBUG [M:0;jenkins-hbase17:34365] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-15 10:02:13,528 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-15 10:02:13,528 DEBUG [M:0;jenkins-hbase17:34365] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-15 10:02:13,528 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1694771996994] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1694771996994,5,FailOnTimeoutGroup] 2023-09-15 10:02:13,528 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1694771996990] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1694771996990,5,FailOnTimeoutGroup] 2023-09-15 10:02:13,528 INFO [M:0;jenkins-hbase17:34365] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-15 10:02:13,528 INFO [M:0;jenkins-hbase17:34365] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-15 10:02:13,528 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-15 10:02:13,528 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-15 10:02:13,528 INFO [M:0;jenkins-hbase17:34365] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-09-15 10:02:13,528 DEBUG [M:0;jenkins-hbase17:34365] master.HMaster(1512): Stopping service threads 2023-09-15 10:02:13,529 INFO [M:0;jenkins-hbase17:34365] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-15 10:02:13,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-15 10:02:13,529 ERROR [M:0;jenkins-hbase17:34365] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-15 10:02:13,529 INFO [M:0;jenkins-hbase17:34365] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-15 10:02:13,529 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-15 10:02:13,530 DEBUG [M:0;jenkins-hbase17:34365] zookeeper.ZKUtil(398): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-15 10:02:13,530 WARN [M:0;jenkins-hbase17:34365] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-15 10:02:13,530 INFO [M:0;jenkins-hbase17:34365] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-15 10:02:13,530 INFO [M:0;jenkins-hbase17:34365] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-15 10:02:13,530 DEBUG [M:0;jenkins-hbase17:34365] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-15 10:02:13,530 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 10:02:13,530 DEBUG [M:0;jenkins-hbase17:34365] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 10:02:13,530 DEBUG [M:0;jenkins-hbase17:34365] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-15 10:02:13,530 DEBUG [M:0;jenkins-hbase17:34365] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 10:02:13,531 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.04 KB heapSize=452.22 KB 2023-09-15 10:02:13,560 INFO [M:0;jenkins-hbase17:34365] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.04 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4afaad93aba945ecab234af0f7fc6f16 2023-09-15 10:02:13,564 INFO [M:0;jenkins-hbase17:34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4afaad93aba945ecab234af0f7fc6f16 2023-09-15 10:02:13,565 DEBUG [M:0;jenkins-hbase17:34365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4afaad93aba945ecab234af0f7fc6f16 as hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4afaad93aba945ecab234af0f7fc6f16 2023-09-15 10:02:13,568 INFO [M:0;jenkins-hbase17:34365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4afaad93aba945ecab234af0f7fc6f16 2023-09-15 10:02:13,569 INFO [M:0;jenkins-hbase17:34365] regionserver.HStore(1080): Added hdfs://localhost:38409/user/jenkins/test-data/ec589362-8cf5-74ef-db52-edccc57bb6a6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4afaad93aba945ecab234af0f7fc6f16, entries=119, sequenceid=899, filesize=28.6 K 2023-09-15 10:02:13,570 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegion(2948): Finished flush of dataSize ~376.04 KB/385063, heapSize ~452.20 KB/463056, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 40ms, sequenceid=899, compaction requested=false 2023-09-15 10:02:13,571 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-15 10:02:13,571 DEBUG [M:0;jenkins-hbase17:34365] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-15 10:02:13,577 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-15 10:02:13,577 INFO [M:0;jenkins-hbase17:34365] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-15 10:02:13,578 INFO [M:0;jenkins-hbase17:34365] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:34365 2023-09-15 10:02:13,579 DEBUG [M:0;jenkins-hbase17:34365] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,34365,1694771994680 already deleted, retry=false 2023-09-15 10:02:13,625 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,625 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:46549-0x100af0697fe0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,625 INFO [RS:1;jenkins-hbase17:46549] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,46549,1694771995795; zookeeper connection closed. 2023-09-15 10:02:13,626 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2b58257f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2b58257f 2023-09-15 10:02:13,725 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,725 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): master:34365-0x100af0697fe0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,725 INFO [M:0;jenkins-hbase17:34365] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,34365,1694771994680; zookeeper connection closed. 2023-09-15 10:02:13,825 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,825 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:35307-0x100af0697fe0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,825 INFO [RS:0;jenkins-hbase17:35307] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35307,1694771995748; zookeeper connection closed. 2023-09-15 10:02:13,826 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@653b1454] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@653b1454 2023-09-15 10:02:13,926 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,926 DEBUG [Listener at localhost/42561-EventThread] zookeeper.ZKWatcher(600): regionserver:34885-0x100af0697fe0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-15 10:02:13,926 INFO [RS:2;jenkins-hbase17:34885] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,34885,1694771995831; zookeeper connection closed. 2023-09-15 10:02:13,926 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4dcfbe46] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4dcfbe46 2023-09-15 10:02:13,927 INFO [Listener at jenkins-hbase17.apache.org/42523] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-15 10:02:13,927 WARN [Listener at jenkins-hbase17.apache.org/42523] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 10:02:13,932 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 10:02:14,039 WARN [BP-2075844699-136.243.18.41-1694771991416 heartbeating to localhost/127.0.0.1:38409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 10:02:14,039 WARN [BP-2075844699-136.243.18.41-1694771991416 heartbeating to localhost/127.0.0.1:38409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2075844699-136.243.18.41-1694771991416 (Datanode Uuid ec34ad9d-5067-4cb4-b4c2-fefef2ccc5ff) service to localhost/127.0.0.1:38409 2023-09-15 10:02:14,043 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data5/current/BP-2075844699-136.243.18.41-1694771991416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 10:02:14,044 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data6/current/BP-2075844699-136.243.18.41-1694771991416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 10:02:14,045 WARN [Listener at jenkins-hbase17.apache.org/42523] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 10:02:14,049 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 10:02:14,154 WARN [BP-2075844699-136.243.18.41-1694771991416 heartbeating to localhost/127.0.0.1:38409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 10:02:14,154 WARN [BP-2075844699-136.243.18.41-1694771991416 heartbeating to localhost/127.0.0.1:38409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2075844699-136.243.18.41-1694771991416 (Datanode Uuid f940ce08-a4ec-4b25-8f7a-88744268866c) service to localhost/127.0.0.1:38409 2023-09-15 10:02:14,155 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data3/current/BP-2075844699-136.243.18.41-1694771991416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 10:02:14,156 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data4/current/BP-2075844699-136.243.18.41-1694771991416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 10:02:14,156 WARN [Listener at jenkins-hbase17.apache.org/42523] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-15 10:02:14,160 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 10:02:14,264 WARN [BP-2075844699-136.243.18.41-1694771991416 heartbeating to localhost/127.0.0.1:38409] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-15 10:02:14,264 WARN [BP-2075844699-136.243.18.41-1694771991416 heartbeating to localhost/127.0.0.1:38409] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2075844699-136.243.18.41-1694771991416 (Datanode Uuid 7277f8bf-c42c-4f4d-abf7-a3729c581f51) service to localhost/127.0.0.1:38409 2023-09-15 10:02:14,265 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data1/current/BP-2075844699-136.243.18.41-1694771991416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 10:02:14,266 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9cdbb347-84fd-2a7c-2b3e-0cbd515baaca/cluster_d7ca833a-a741-5903-59cf-d947c5b81de0/dfs/data/data2/current/BP-2075844699-136.243.18.41-1694771991416] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-15 10:02:14,291 INFO [Listener at jenkins-hbase17.apache.org/42523] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-15 10:02:14,420 INFO [Listener at jenkins-hbase17.apache.org/42523] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-15 10:02:14,498 INFO [Listener at jenkins-hbase17.apache.org/42523] hbase.HBaseTestingUtility(1293): Minicluster is down