2023-07-24 07:06:25,076 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 07:06:25,338 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57 2023-07-24 07:06:25,338 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 07:06:25,338 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 07:06:25,377 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 07:06:25,625 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 07:06:25,626 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458, deleteOnExit=true 2023-07-24 07:06:25,626 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 07:06:25,627 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/test.cache.data in system properties and HBase conf 2023-07-24 07:06:25,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 07:06:25,628 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop.log.dir in system properties and HBase conf 2023-07-24 07:06:25,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 07:06:25,629 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 07:06:25,630 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 07:06:26,008 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 07:06:26,014 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:26,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:26,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 07:06:26,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:26,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 07:06:26,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 07:06:26,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:26,017 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:26,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 07:06:26,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/nfs.dump.dir in system properties and HBase conf 2023-07-24 07:06:26,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir in system properties and HBase conf 2023-07-24 07:06:26,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:26,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 07:06:26,020 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 07:06:26,635 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 07:06:26,641 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 07:06:26,911 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 07:06:27,070 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 07:06:27,088 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:27,128 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:27,174 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_localhost_32875_hdfs____.14id4v/webapp 2023-07-24 07:06:27,341 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32875 2023-07-24 07:06:27,375 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 07:06:27,376 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 07:06:27,917 WARN [Listener at localhost/38471] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:28,033 WARN [Listener at localhost/38471] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 07:06:28,054 WARN [Listener at localhost/38471] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:28,060 INFO [Listener at localhost/38471] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:28,069 INFO [Listener at localhost/38471] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_localhost_39403_datanode____.25i88/webapp 2023-07-24 07:06:28,195 INFO [Listener at localhost/38471] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39403 2023-07-24 07:06:28,735 WARN [Listener at localhost/38747] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:28,785 WARN [Listener at localhost/38747] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 07:06:28,793 WARN [Listener at localhost/38747] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:28,796 INFO [Listener at localhost/38747] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:28,809 INFO [Listener at localhost/38747] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_localhost_40797_datanode____7f1z40/webapp 2023-07-24 07:06:28,947 INFO [Listener at localhost/38747] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40797 2023-07-24 07:06:28,971 WARN [Listener at localhost/44113] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:29,063 WARN [Listener at localhost/44113] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 07:06:29,073 WARN [Listener at localhost/44113] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:29,078 INFO [Listener at localhost/44113] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:29,093 INFO [Listener at localhost/44113] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_localhost_45647_datanode____.hxbb41/webapp 2023-07-24 07:06:29,231 INFO [Listener at localhost/44113] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45647 2023-07-24 07:06:29,259 WARN [Listener at localhost/34763] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 07:06:29,492 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf6413a3158e3a2d9: Processing first storage report for DS-1896f7c2-2539-487b-bce7-5afd875e5d7e from datanode 8da83f3f-7368-4c77-bc30-f3c94ba21e6a 2023-07-24 07:06:29,494 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf6413a3158e3a2d9: from storage DS-1896f7c2-2539-487b-bce7-5afd875e5d7e node DatanodeRegistration(127.0.0.1:38705, datanodeUuid=8da83f3f-7368-4c77-bc30-f3c94ba21e6a, infoPort=35051, infoSecurePort=0, ipcPort=44113, storageInfo=lv=-57;cid=testClusterID;nsid=891479888;c=1690182386713), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,495 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf6413a3158e3a2d9: Processing first storage report for DS-a3c19030-f0a2-4c0f-ad20-caf169245bb8 from datanode 8da83f3f-7368-4c77-bc30-f3c94ba21e6a 2023-07-24 07:06:29,495 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf6413a3158e3a2d9: from storage DS-a3c19030-f0a2-4c0f-ad20-caf169245bb8 node DatanodeRegistration(127.0.0.1:38705, datanodeUuid=8da83f3f-7368-4c77-bc30-f3c94ba21e6a, infoPort=35051, infoSecurePort=0, ipcPort=44113, storageInfo=lv=-57;cid=testClusterID;nsid=891479888;c=1690182386713), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,496 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9819cc162befa4ac: Processing first storage report for DS-68865a30-b053-49de-8def-9ebe27d4f1bc from datanode c5095bb5-94be-4bf9-b472-4d4eaa417fed 2023-07-24 07:06:29,496 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9819cc162befa4ac: from storage DS-68865a30-b053-49de-8def-9ebe27d4f1bc node DatanodeRegistration(127.0.0.1:41881, datanodeUuid=c5095bb5-94be-4bf9-b472-4d4eaa417fed, infoPort=41305, infoSecurePort=0, ipcPort=38747, storageInfo=lv=-57;cid=testClusterID;nsid=891479888;c=1690182386713), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,496 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9819cc162befa4ac: Processing first storage report for DS-0d0cbb44-ab99-4858-887b-070f6b31026d from datanode c5095bb5-94be-4bf9-b472-4d4eaa417fed 2023-07-24 07:06:29,496 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9819cc162befa4ac: from storage DS-0d0cbb44-ab99-4858-887b-070f6b31026d node DatanodeRegistration(127.0.0.1:41881, datanodeUuid=c5095bb5-94be-4bf9-b472-4d4eaa417fed, infoPort=41305, infoSecurePort=0, ipcPort=38747, storageInfo=lv=-57;cid=testClusterID;nsid=891479888;c=1690182386713), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,523 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3393240e1debdb3b: Processing first storage report for DS-19e17add-1a02-40ed-85da-aece401f66c3 from datanode c19a7ffe-8b8f-4ff8-a3cd-d8e5ab7fd9f7 2023-07-24 07:06:29,523 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3393240e1debdb3b: from storage DS-19e17add-1a02-40ed-85da-aece401f66c3 node DatanodeRegistration(127.0.0.1:33563, datanodeUuid=c19a7ffe-8b8f-4ff8-a3cd-d8e5ab7fd9f7, infoPort=40129, infoSecurePort=0, ipcPort=34763, storageInfo=lv=-57;cid=testClusterID;nsid=891479888;c=1690182386713), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,523 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3393240e1debdb3b: Processing first storage report for DS-2b6c275b-2118-43ae-a3de-d130ac32dd1f from datanode c19a7ffe-8b8f-4ff8-a3cd-d8e5ab7fd9f7 2023-07-24 07:06:29,523 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3393240e1debdb3b: from storage DS-2b6c275b-2118-43ae-a3de-d130ac32dd1f node DatanodeRegistration(127.0.0.1:33563, datanodeUuid=c19a7ffe-8b8f-4ff8-a3cd-d8e5ab7fd9f7, infoPort=40129, infoSecurePort=0, ipcPort=34763, storageInfo=lv=-57;cid=testClusterID;nsid=891479888;c=1690182386713), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 07:06:29,771 DEBUG [Listener at localhost/34763] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57 2023-07-24 07:06:29,862 INFO [Listener at localhost/34763] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/zookeeper_0, clientPort=60170, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 07:06:29,883 INFO [Listener at localhost/34763] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60170 2023-07-24 07:06:29,895 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:29,898 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:30,618 INFO [Listener at localhost/34763] util.FSUtils(471): Created version file at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 with version=8 2023-07-24 07:06:30,619 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/hbase-staging 2023-07-24 07:06:30,981 INFO [Listener at localhost/34763] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 07:06:31,548 INFO [Listener at localhost/34763] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:31,586 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:31,587 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:31,588 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:31,588 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:31,588 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:31,756 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:31,831 DEBUG [Listener at localhost/34763] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 07:06:31,949 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34101 2023-07-24 07:06:31,966 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:31,969 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:31,996 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34101 connecting to ZooKeeper ensemble=127.0.0.1:60170 2023-07-24 07:06:32,058 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:341010x0, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34101-0x101962713520000 connected 2023-07-24 07:06:32,112 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,113 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,128 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,138 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34101 2023-07-24 07:06:32,138 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34101 2023-07-24 07:06:32,138 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34101 2023-07-24 07:06:32,140 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34101 2023-07-24 07:06:32,140 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34101 2023-07-24 07:06:32,148 INFO [Listener at localhost/34763] master.HMaster(444): hbase.rootdir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, hbase.cluster.distributed=false 2023-07-24 07:06:32,229 INFO [Listener at localhost/34763] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:32,229 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,229 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,229 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:32,229 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,229 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:32,236 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:32,241 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35087 2023-07-24 07:06:32,245 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 07:06:32,254 INFO [Listener at localhost/34763] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 07:06:32,255 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,258 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,260 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35087 connecting to ZooKeeper ensemble=127.0.0.1:60170 2023-07-24 07:06:32,276 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:350870x0, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,277 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:350870x0, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,279 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:350870x0, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35087-0x101962713520001 connected 2023-07-24 07:06:32,282 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,292 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35087 2023-07-24 07:06:32,292 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35087 2023-07-24 07:06:32,293 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35087 2023-07-24 07:06:32,298 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35087 2023-07-24 07:06:32,301 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35087 2023-07-24 07:06:32,314 INFO [Listener at localhost/34763] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:32,315 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,315 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,316 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:32,316 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,316 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:32,316 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:32,319 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44417 2023-07-24 07:06:32,320 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 07:06:32,321 INFO [Listener at localhost/34763] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 07:06:32,322 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,324 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,327 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44417 connecting to ZooKeeper ensemble=127.0.0.1:60170 2023-07-24 07:06:32,331 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:444170x0, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44417-0x101962713520002 connected 2023-07-24 07:06:32,333 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,334 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,335 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,343 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44417 2023-07-24 07:06:32,343 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44417 2023-07-24 07:06:32,344 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44417 2023-07-24 07:06:32,345 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44417 2023-07-24 07:06:32,346 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44417 2023-07-24 07:06:32,361 INFO [Listener at localhost/34763] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 07:06:32,361 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,361 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,361 INFO [Listener at localhost/34763] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 07:06:32,361 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 07:06:32,362 INFO [Listener at localhost/34763] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 07:06:32,362 INFO [Listener at localhost/34763] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 07:06:32,368 INFO [Listener at localhost/34763] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43877 2023-07-24 07:06:32,368 INFO [Listener at localhost/34763] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 07:06:32,369 INFO [Listener at localhost/34763] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 07:06:32,371 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,373 INFO [Listener at localhost/34763] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,375 INFO [Listener at localhost/34763] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43877 connecting to ZooKeeper ensemble=127.0.0.1:60170 2023-07-24 07:06:32,381 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:438770x0, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 07:06:32,383 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:438770x0, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:06:32,384 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:438770x0, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:06:32,385 DEBUG [Listener at localhost/34763] zookeeper.ZKUtil(164): regionserver:438770x0, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 07:06:32,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43877-0x101962713520003 connected 2023-07-24 07:06:32,391 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43877 2023-07-24 07:06:32,391 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43877 2023-07-24 07:06:32,395 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43877 2023-07-24 07:06:32,398 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43877 2023-07-24 07:06:32,399 DEBUG [Listener at localhost/34763] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43877 2023-07-24 07:06:32,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:32,415 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 07:06:32,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:32,444 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,444 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,444 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,445 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:32,444 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 07:06:32,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 07:06:32,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 07:06:32,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34101,1690182390803 from backup master directory 2023-07-24 07:06:32,453 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:32,454 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 07:06:32,454 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:32,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:32,458 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 07:06:32,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 07:06:32,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/hbase.id with ID: ab9a9597-6e69-4570-9519-9e11fe0a9f41 2023-07-24 07:06:32,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 07:06:32,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:32,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5308c337 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:32,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b0d0547, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:32,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:32,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 07:06:32,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 07:06:32,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 07:06:32,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 07:06:32,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 07:06:32,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:32,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store-tmp 2023-07-24 07:06:32,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:32,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 07:06:32,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 07:06:32,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:06:32,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 07:06:32,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/WALs/jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:33,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34101%2C1690182390803, suffix=, logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/WALs/jenkins-hbase4.apache.org,34101,1690182390803, archiveDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/oldWALs, maxLogs=10 2023-07-24 07:06:33,121 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK] 2023-07-24 07:06:33,121 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK] 2023-07-24 07:06:33,121 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK] 2023-07-24 07:06:33,130 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 07:06:33,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/WALs/jenkins-hbase4.apache.org,34101,1690182390803/jenkins-hbase4.apache.org%2C34101%2C1690182390803.1690182393022 2023-07-24 07:06:33,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK], DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK], DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK]] 2023-07-24 07:06:33,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:33,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:33,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,337 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,347 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 07:06:33,377 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 07:06:33,392 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:33,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 07:06:33,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:33,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64108441, jitterRate=-0.044709786772727966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:33,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 07:06:33,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 07:06:33,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 07:06:33,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 07:06:33,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 07:06:33,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 07:06:33,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 53 msec 2023-07-24 07:06:33,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 07:06:33,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 07:06:33,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 07:06:33,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 07:06:33,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 07:06:33,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 07:06:33,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 07:06:33,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 07:06:33,621 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 07:06:33,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 07:06:33,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 07:06:33,642 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,642 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,643 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,642 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,642 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 07:06:33,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34101,1690182390803, sessionid=0x101962713520000, setting cluster-up flag (Was=false) 2023-07-24 07:06:33,666 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 07:06:33,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:33,689 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:33,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 07:06:33,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:33,714 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp 2023-07-24 07:06:33,812 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(951): ClusterId : ab9a9597-6e69-4570-9519-9e11fe0a9f41 2023-07-24 07:06:33,812 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(951): ClusterId : ab9a9597-6e69-4570-9519-9e11fe0a9f41 2023-07-24 07:06:33,813 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(951): ClusterId : ab9a9597-6e69-4570-9519-9e11fe0a9f41 2023-07-24 07:06:33,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 07:06:33,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 07:06:33,834 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 07:06:33,835 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 07:06:33,834 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 07:06:33,843 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 07:06:33,843 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 07:06:33,844 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 07:06:33,843 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 07:06:33,844 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 07:06:33,844 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 07:06:33,848 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 07:06:33,848 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 07:06:33,849 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 07:06:33,851 DEBUG [RS:2;jenkins-hbase4:43877] zookeeper.ReadOnlyZKClient(139): Connect 0x28bdfcd8 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:33,852 DEBUG [RS:0;jenkins-hbase4:35087] zookeeper.ReadOnlyZKClient(139): Connect 0x00dc9dab to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:33,851 DEBUG [RS:1;jenkins-hbase4:44417] zookeeper.ReadOnlyZKClient(139): Connect 0x075cb637 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:33,889 DEBUG [RS:2;jenkins-hbase4:43877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@267a07bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:33,890 DEBUG [RS:2;jenkins-hbase4:43877] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@224597a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:06:33,923 DEBUG [RS:0;jenkins-hbase4:35087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d53e093, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:33,924 DEBUG [RS:0;jenkins-hbase4:35087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cd82e6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:06:33,927 DEBUG [RS:1;jenkins-hbase4:44417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bb8acf6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:33,928 DEBUG [RS:1;jenkins-hbase4:44417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cea40a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:06:33,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 07:06:33,945 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44417 2023-07-24 07:06:33,946 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43877 2023-07-24 07:06:33,946 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35087 2023-07-24 07:06:33,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,952 INFO [RS:1;jenkins-hbase4:44417] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 07:06:33,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 07:06:33,953 INFO [RS:1;jenkins-hbase4:44417] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 07:06:33,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 07:06:33,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:33,954 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 07:06:33,953 INFO [RS:0;jenkins-hbase4:35087] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 07:06:33,954 INFO [RS:0;jenkins-hbase4:35087] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 07:06:33,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:33,955 INFO [RS:2;jenkins-hbase4:43877] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 07:06:33,955 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 07:06:33,956 INFO [RS:2;jenkins-hbase4:43877] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 07:06:33,956 INFO [RS:0;jenkins-hbase4:35087] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,956 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 07:06:33,955 INFO [RS:1;jenkins-hbase4:44417] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,956 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 07:06:33,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:33,956 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 07:06:33,957 INFO [RS:2;jenkins-hbase4:43877] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:33,957 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 07:06:33,960 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34101,1690182390803 with isa=jenkins-hbase4.apache.org/172.31.14.131:44417, startcode=1690182392314 2023-07-24 07:06:33,960 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34101,1690182390803 with isa=jenkins-hbase4.apache.org/172.31.14.131:43877, startcode=1690182392360 2023-07-24 07:06:33,962 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34101,1690182390803 with isa=jenkins-hbase4.apache.org/172.31.14.131:35087, startcode=1690182392228 2023-07-24 07:06:33,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690182423983 2023-07-24 07:06:33,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 07:06:34,000 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 07:06:34,001 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 07:06:34,008 DEBUG [RS:2;jenkins-hbase4:43877] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 07:06:34,008 DEBUG [RS:0;jenkins-hbase4:35087] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 07:06:34,011 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:34,012 DEBUG [RS:1;jenkins-hbase4:44417] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 07:06:34,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 07:06:34,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 07:06:34,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 07:06:34,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 07:06:34,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 07:06:34,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 07:06:34,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 07:06:34,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 07:06:34,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 07:06:34,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 07:06:34,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690182394051,5,FailOnTimeoutGroup] 2023-07-24 07:06:34,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690182394052,5,FailOnTimeoutGroup] 2023-07-24 07:06:34,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 07:06:34,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,097 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:34,099 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:34,099 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:06:34,104 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60025, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 07:06:34,104 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47989, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 07:06:34,104 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49179, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 07:06:34,127 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34101] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,142 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34101] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,156 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34101] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,159 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:06:34,159 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:06:34,159 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:06:34,163 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38471 2023-07-24 07:06:34,164 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 07:06:34,159 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38471 2023-07-24 07:06:34,163 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38471 2023-07-24 07:06:34,169 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 07:06:34,169 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 07:06:34,178 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:06:34,186 DEBUG [RS:2;jenkins-hbase4:43877] zookeeper.ZKUtil(162): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,187 DEBUG [RS:1;jenkins-hbase4:44417] zookeeper.ZKUtil(162): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,187 DEBUG [RS:0;jenkins-hbase4:35087] zookeeper.ZKUtil(162): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,186 WARN [RS:2;jenkins-hbase4:43877] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:34,192 INFO [RS:2;jenkins-hbase4:43877] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,193 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,187 WARN [RS:1;jenkins-hbase4:44417] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:34,187 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43877,1690182392360] 2023-07-24 07:06:34,194 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44417,1690182392314] 2023-07-24 07:06:34,194 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35087,1690182392228] 2023-07-24 07:06:34,187 WARN [RS:0;jenkins-hbase4:35087] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 07:06:34,195 INFO [RS:0;jenkins-hbase4:35087] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,203 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,194 INFO [RS:1;jenkins-hbase4:44417] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,204 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,215 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:34,219 DEBUG [RS:1;jenkins-hbase4:44417] zookeeper.ZKUtil(162): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,219 DEBUG [RS:0;jenkins-hbase4:35087] zookeeper.ZKUtil(162): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,220 DEBUG [RS:1;jenkins-hbase4:44417] zookeeper.ZKUtil(162): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,219 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 07:06:34,221 DEBUG [RS:1;jenkins-hbase4:44417] zookeeper.ZKUtil(162): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,220 DEBUG [RS:0;jenkins-hbase4:35087] zookeeper.ZKUtil(162): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,223 DEBUG [RS:0;jenkins-hbase4:35087] zookeeper.ZKUtil(162): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,226 DEBUG [RS:2;jenkins-hbase4:43877] zookeeper.ZKUtil(162): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/info 2023-07-24 07:06:34,228 DEBUG [RS:2;jenkins-hbase4:43877] zookeeper.ZKUtil(162): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,228 DEBUG [RS:2;jenkins-hbase4:43877] zookeeper.ZKUtil(162): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,229 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 07:06:34,230 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,230 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 07:06:34,234 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/rep_barrier 2023-07-24 07:06:34,235 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 07:06:34,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 07:06:34,236 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 07:06:34,236 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 07:06:34,236 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 07:06:34,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/table 2023-07-24 07:06:34,242 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 07:06:34,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,246 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740 2023-07-24 07:06:34,251 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740 2023-07-24 07:06:34,259 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 07:06:34,262 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 07:06:34,269 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:34,269 INFO [RS:0;jenkins-hbase4:35087] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 07:06:34,269 INFO [RS:1;jenkins-hbase4:44417] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 07:06:34,271 INFO [RS:2;jenkins-hbase4:43877] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 07:06:34,271 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62194208, jitterRate=-0.07323408126831055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 07:06:34,271 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 07:06:34,271 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 07:06:34,271 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 07:06:34,272 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 07:06:34,272 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 07:06:34,272 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 07:06:34,276 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 07:06:34,276 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 07:06:34,291 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 07:06:34,292 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 07:06:34,301 INFO [RS:0;jenkins-hbase4:35087] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 07:06:34,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 07:06:34,306 INFO [RS:1;jenkins-hbase4:44417] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 07:06:34,315 INFO [RS:0;jenkins-hbase4:35087] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 07:06:34,315 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,318 INFO [RS:1;jenkins-hbase4:44417] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 07:06:34,321 INFO [RS:2;jenkins-hbase4:43877] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 07:06:34,321 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,327 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 07:06:34,341 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 07:06:34,343 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 07:06:34,348 INFO [RS:2;jenkins-hbase4:43877] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 07:06:34,348 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,350 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 07:06:34,354 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 07:06:34,360 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,360 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,360 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,360 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,361 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,361 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,361 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,361 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,361 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,362 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,361 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:34,362 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:34,362 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,362 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,363 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,363 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,363 DEBUG [RS:1;jenkins-hbase4:44417] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,363 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,363 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 07:06:34,364 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,364 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,364 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,364 DEBUG [RS:0;jenkins-hbase4:35087] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,366 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,366 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,366 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,367 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,367 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,367 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,367 DEBUG [RS:2;jenkins-hbase4:43877] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 07:06:34,376 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,376 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,376 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,379 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,379 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,379 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,399 INFO [RS:0;jenkins-hbase4:35087] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 07:06:34,401 INFO [RS:1;jenkins-hbase4:44417] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 07:06:34,401 INFO [RS:2;jenkins-hbase4:43877] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 07:06:34,405 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35087,1690182392228-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,405 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44417,1690182392314-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,405 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43877,1690182392360-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:34,450 INFO [RS:0;jenkins-hbase4:35087] regionserver.Replication(203): jenkins-hbase4.apache.org,35087,1690182392228 started 2023-07-24 07:06:34,451 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35087,1690182392228, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35087, sessionid=0x101962713520001 2023-07-24 07:06:34,454 INFO [RS:2;jenkins-hbase4:43877] regionserver.Replication(203): jenkins-hbase4.apache.org,43877,1690182392360 started 2023-07-24 07:06:34,454 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43877,1690182392360, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43877, sessionid=0x101962713520003 2023-07-24 07:06:34,455 INFO [RS:1;jenkins-hbase4:44417] regionserver.Replication(203): jenkins-hbase4.apache.org,44417,1690182392314 started 2023-07-24 07:06:34,455 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44417,1690182392314, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44417, sessionid=0x101962713520002 2023-07-24 07:06:34,455 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 07:06:34,455 DEBUG [RS:1;jenkins-hbase4:44417] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,455 DEBUG [RS:1;jenkins-hbase4:44417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44417,1690182392314' 2023-07-24 07:06:34,455 DEBUG [RS:1;jenkins-hbase4:44417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 07:06:34,455 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 07:06:34,455 DEBUG [RS:0;jenkins-hbase4:35087] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,456 DEBUG [RS:0;jenkins-hbase4:35087] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35087,1690182392228' 2023-07-24 07:06:34,457 DEBUG [RS:0;jenkins-hbase4:35087] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 07:06:34,457 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 07:06:34,458 DEBUG [RS:2;jenkins-hbase4:43877] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,458 DEBUG [RS:2;jenkins-hbase4:43877] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43877,1690182392360' 2023-07-24 07:06:34,458 DEBUG [RS:1;jenkins-hbase4:44417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 07:06:34,458 DEBUG [RS:0;jenkins-hbase4:35087] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 07:06:34,458 DEBUG [RS:2;jenkins-hbase4:43877] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 07:06:34,459 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 07:06:34,459 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 07:06:34,459 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 07:06:34,459 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 07:06:34,459 DEBUG [RS:0;jenkins-hbase4:35087] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:34,460 DEBUG [RS:0;jenkins-hbase4:35087] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35087,1690182392228' 2023-07-24 07:06:34,460 DEBUG [RS:0;jenkins-hbase4:35087] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:34,459 DEBUG [RS:1;jenkins-hbase4:44417] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:34,464 DEBUG [RS:2;jenkins-hbase4:43877] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 07:06:34,465 DEBUG [RS:1;jenkins-hbase4:44417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44417,1690182392314' 2023-07-24 07:06:34,465 DEBUG [RS:1;jenkins-hbase4:44417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:34,465 DEBUG [RS:0;jenkins-hbase4:35087] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:34,466 DEBUG [RS:1;jenkins-hbase4:44417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:34,466 DEBUG [RS:1;jenkins-hbase4:44417] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 07:06:34,466 INFO [RS:1;jenkins-hbase4:44417] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 07:06:34,466 INFO [RS:1;jenkins-hbase4:44417] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 07:06:34,471 DEBUG [RS:0;jenkins-hbase4:35087] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 07:06:34,471 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 07:06:34,471 INFO [RS:0;jenkins-hbase4:35087] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 07:06:34,474 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 07:06:34,474 INFO [RS:0;jenkins-hbase4:35087] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 07:06:34,476 DEBUG [RS:2;jenkins-hbase4:43877] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,476 DEBUG [RS:2;jenkins-hbase4:43877] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43877,1690182392360' 2023-07-24 07:06:34,476 DEBUG [RS:2;jenkins-hbase4:43877] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:34,477 DEBUG [RS:2;jenkins-hbase4:43877] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:34,478 DEBUG [RS:2;jenkins-hbase4:43877] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 07:06:34,478 INFO [RS:2;jenkins-hbase4:43877] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 07:06:34,478 INFO [RS:2;jenkins-hbase4:43877] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 07:06:34,508 DEBUG [jenkins-hbase4:34101] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 07:06:34,512 DEBUG [jenkins-hbase4:34101] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:34,526 DEBUG [jenkins-hbase4:34101] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:34,526 DEBUG [jenkins-hbase4:34101] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:34,526 DEBUG [jenkins-hbase4:34101] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:34,527 DEBUG [jenkins-hbase4:34101] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:34,531 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43877,1690182392360, state=OPENING 2023-07-24 07:06:34,542 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 07:06:34,543 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:34,546 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 07:06:34,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:06:34,582 INFO [RS:0;jenkins-hbase4:35087] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35087%2C1690182392228, suffix=, logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,35087,1690182392228, archiveDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs, maxLogs=32 2023-07-24 07:06:34,582 INFO [RS:1;jenkins-hbase4:44417] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44417%2C1690182392314, suffix=, logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,44417,1690182392314, archiveDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs, maxLogs=32 2023-07-24 07:06:34,600 INFO [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43877%2C1690182392360, suffix=, logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,43877,1690182392360, archiveDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs, maxLogs=32 2023-07-24 07:06:34,657 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK] 2023-07-24 07:06:34,658 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK] 2023-07-24 07:06:34,658 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK] 2023-07-24 07:06:34,668 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK] 2023-07-24 07:06:34,669 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK] 2023-07-24 07:06:34,677 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK] 2023-07-24 07:06:34,679 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK] 2023-07-24 07:06:34,679 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK] 2023-07-24 07:06:34,679 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK] 2023-07-24 07:06:34,702 INFO [RS:0;jenkins-hbase4:35087] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,35087,1690182392228/jenkins-hbase4.apache.org%2C35087%2C1690182392228.1690182394589 2023-07-24 07:06:34,702 INFO [RS:1;jenkins-hbase4:44417] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,44417,1690182392314/jenkins-hbase4.apache.org%2C44417%2C1690182392314.1690182394590 2023-07-24 07:06:34,707 INFO [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,43877,1690182392360/jenkins-hbase4.apache.org%2C43877%2C1690182392360.1690182394602 2023-07-24 07:06:34,710 DEBUG [RS:1;jenkins-hbase4:44417] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK], DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK], DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK]] 2023-07-24 07:06:34,710 DEBUG [RS:0;jenkins-hbase4:35087] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK], DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK], DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK]] 2023-07-24 07:06:34,711 DEBUG [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK], DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK], DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK]] 2023-07-24 07:06:34,757 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:34,760 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:06:34,764 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:06:34,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 07:06:34,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 07:06:34,789 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43877%2C1690182392360.meta, suffix=.meta, logDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,43877,1690182392360, archiveDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs, maxLogs=32 2023-07-24 07:06:34,821 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK] 2023-07-24 07:06:34,846 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK] 2023-07-24 07:06:34,846 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK] 2023-07-24 07:06:34,868 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/WALs/jenkins-hbase4.apache.org,43877,1690182392360/jenkins-hbase4.apache.org%2C43877%2C1690182392360.meta.1690182394791.meta 2023-07-24 07:06:34,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33563,DS-19e17add-1a02-40ed-85da-aece401f66c3,DISK], DatanodeInfoWithStorage[127.0.0.1:41881,DS-68865a30-b053-49de-8def-9ebe27d4f1bc,DISK], DatanodeInfoWithStorage[127.0.0.1:38705,DS-1896f7c2-2539-487b-bce7-5afd875e5d7e,DISK]] 2023-07-24 07:06:34,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:34,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 07:06:34,877 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:34,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 07:06:34,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 07:06:34,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 07:06:34,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 07:06:34,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:34,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 07:06:34,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 07:06:34,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 07:06:34,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/info 2023-07-24 07:06:34,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/info 2023-07-24 07:06:34,912 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 07:06:34,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 07:06:34,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/rep_barrier 2023-07-24 07:06:34,915 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/rep_barrier 2023-07-24 07:06:34,918 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 07:06:34,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,919 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 07:06:34,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/table 2023-07-24 07:06:34,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/table 2023-07-24 07:06:34,922 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 07:06:34,923 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:34,929 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740 2023-07-24 07:06:34,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740 2023-07-24 07:06:34,936 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 07:06:34,939 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 07:06:34,941 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60999235, jitterRate=-0.09104056656360626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 07:06:34,944 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 07:06:34,959 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690182394747 2023-07-24 07:06:34,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 07:06:34,989 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 07:06:34,990 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43877,1690182392360, state=OPEN 2023-07-24 07:06:34,993 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 07:06:34,993 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 07:06:34,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 07:06:34,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43877,1690182392360 in 442 msec 2023-07-24 07:06:35,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 07:06:35,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 695 msec 2023-07-24 07:06:35,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1740 sec 2023-07-24 07:06:35,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690182395015, completionTime=-1 2023-07-24 07:06:35,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 07:06:35,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 07:06:35,116 DEBUG [hconnection-0x7fbb8b71-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:35,120 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:35,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 07:06:35,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690182455152 2023-07-24 07:06:35,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690182515153 2023-07-24 07:06:35,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 137 msec 2023-07-24 07:06:35,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34101,1690182390803-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34101,1690182390803-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34101,1690182390803-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34101, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 07:06:35,226 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 07:06:35,240 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 07:06:35,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:35,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 07:06:35,265 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:35,270 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:35,305 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,309 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46 empty. 2023-07-24 07:06:35,310 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 07:06:35,365 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:35,368 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3ce2b34a27d3aafd626a5c3e7bbec46, NAME => 'hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:06:35,412 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:35,412 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c3ce2b34a27d3aafd626a5c3e7bbec46, disabling compactions & flushes 2023-07-24 07:06:35,412 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,412 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,412 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. after waiting 0 ms 2023-07-24 07:06:35,412 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,412 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,413 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c3ce2b34a27d3aafd626a5c3e7bbec46: 2023-07-24 07:06:35,418 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:35,436 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690182395422"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182395422"}]},"ts":"1690182395422"} 2023-07-24 07:06:35,471 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 07:06:35,473 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:35,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182395473"}]},"ts":"1690182395473"} 2023-07-24 07:06:35,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 07:06:35,490 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:35,491 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:35,491 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:35,491 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:35,491 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:35,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3ce2b34a27d3aafd626a5c3e7bbec46, ASSIGN}] 2023-07-24 07:06:35,497 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c3ce2b34a27d3aafd626a5c3e7bbec46, ASSIGN 2023-07-24 07:06:35,499 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c3ce2b34a27d3aafd626a5c3e7bbec46, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:06:35,652 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 07:06:35,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3ce2b34a27d3aafd626a5c3e7bbec46, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:35,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690182395654"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182395654"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182395654"}]},"ts":"1690182395654"} 2023-07-24 07:06:35,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c3ce2b34a27d3aafd626a5c3e7bbec46, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:06:35,817 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:35,818 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:06:35,822 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:06:35,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,830 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3ce2b34a27d3aafd626a5c3e7bbec46, NAME => 'hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:35,830 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. service=AccessControlService 2023-07-24 07:06:35,831 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:35,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:35,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,835 INFO [StoreOpener-c3ce2b34a27d3aafd626a5c3e7bbec46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,837 DEBUG [StoreOpener-c3ce2b34a27d3aafd626a5c3e7bbec46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/info 2023-07-24 07:06:35,837 DEBUG [StoreOpener-c3ce2b34a27d3aafd626a5c3e7bbec46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/info 2023-07-24 07:06:35,838 INFO [StoreOpener-c3ce2b34a27d3aafd626a5c3e7bbec46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3ce2b34a27d3aafd626a5c3e7bbec46 columnFamilyName info 2023-07-24 07:06:35,841 INFO [StoreOpener-c3ce2b34a27d3aafd626a5c3e7bbec46-1] regionserver.HStore(310): Store=c3ce2b34a27d3aafd626a5c3e7bbec46/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:35,843 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:06:35,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:35,858 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3ce2b34a27d3aafd626a5c3e7bbec46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65746461, jitterRate=-0.02030138671398163}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:35,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3ce2b34a27d3aafd626a5c3e7bbec46: 2023-07-24 07:06:35,865 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46., pid=6, masterSystemTime=1690182395817 2023-07-24 07:06:35,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,870 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:06:35,872 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c3ce2b34a27d3aafd626a5c3e7bbec46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:35,872 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690182395871"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182395871"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182395871"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182395871"}]},"ts":"1690182395871"} 2023-07-24 07:06:35,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 07:06:35,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c3ce2b34a27d3aafd626a5c3e7bbec46, server=jenkins-hbase4.apache.org,44417,1690182392314 in 214 msec 2023-07-24 07:06:35,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 07:06:35,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c3ce2b34a27d3aafd626a5c3e7bbec46, ASSIGN in 387 msec 2023-07-24 07:06:35,893 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:06:35,893 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182395893"}]},"ts":"1690182395893"} 2023-07-24 07:06:35,896 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 07:06:35,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:06:35,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 657 msec 2023-07-24 07:06:35,965 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 07:06:35,967 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 07:06:35,967 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:35,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:36,014 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:36,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 07:06:36,078 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 07:06:36,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 55 msec 2023-07-24 07:06:36,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 07:06:36,116 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 07:06:36,123 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 26 msec 2023-07-24 07:06:36,138 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 07:06:36,141 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 07:06:36,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.687sec 2023-07-24 07:06:36,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 07:06:36,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 07:06:36,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 07:06:36,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34101,1690182390803-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 07:06:36,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34101,1690182390803-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 07:06:36,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 07:06:36,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 07:06:36,199 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:36,203 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:36,208 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/acl/12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,209 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/acl/12db6da8a942ac73eca936629445f8ac empty. 2023-07-24 07:06:36,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 07:06:36,212 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/acl/12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,212 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 07:06:36,219 DEBUG [Listener at localhost/34763] zookeeper.ReadOnlyZKClient(139): Connect 0x0dd3367c to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:36,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,225 DEBUG [Listener at localhost/34763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3817530e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:36,299 DEBUG [hconnection-0x41cd982-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:36,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,328 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:36,329 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:36,330 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 12db6da8a942ac73eca936629445f8ac, NAME => 'hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:06:36,332 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:06:36,332 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 07:06:36,332 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/test.cache.data in system properties and HBase conf 2023-07-24 07:06:36,332 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 07:06:36,333 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop.log.dir in system properties and HBase conf 2023-07-24 07:06:36,333 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 07:06:36,333 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 07:06:36,333 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 07:06:36,333 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:36,333 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 07:06:36,334 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/nfs.dump.dir in system properties and HBase conf 2023-07-24 07:06:36,335 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir in system properties and HBase conf 2023-07-24 07:06:36,335 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 07:06:36,335 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 07:06:36,335 INFO [Listener at localhost/34763] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 07:06:36,373 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:36,374 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 12db6da8a942ac73eca936629445f8ac, disabling compactions & flushes 2023-07-24 07:06:36,374 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,374 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,374 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. after waiting 0 ms 2023-07-24 07:06:36,374 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,374 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,374 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 12db6da8a942ac73eca936629445f8ac: 2023-07-24 07:06:36,379 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:36,381 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690182396381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182396381"}]},"ts":"1690182396381"} 2023-07-24 07:06:36,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 07:06:36,388 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:36,388 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182396388"}]},"ts":"1690182396388"} 2023-07-24 07:06:36,391 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 07:06:36,397 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:36,398 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:36,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:36,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:36,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:36,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=12db6da8a942ac73eca936629445f8ac, ASSIGN}] 2023-07-24 07:06:36,406 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=12db6da8a942ac73eca936629445f8ac, ASSIGN 2023-07-24 07:06:36,409 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=12db6da8a942ac73eca936629445f8ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35087,1690182392228; forceNewPlan=false, retain=false 2023-07-24 07:06:36,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,560 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 07:06:36,562 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=12db6da8a942ac73eca936629445f8ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:36,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690182396562"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182396562"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182396562"}]},"ts":"1690182396562"} 2023-07-24 07:06:36,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 12db6da8a942ac73eca936629445f8ac, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:06:36,723 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:36,723 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:06:36,727 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:06:36,733 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 12db6da8a942ac73eca936629445f8ac, NAME => 'hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:06:36,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. service=AccessControlService 2023-07-24 07:06:36,735 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:36,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:36,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,735 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,737 INFO [StoreOpener-12db6da8a942ac73eca936629445f8ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,740 DEBUG [StoreOpener-12db6da8a942ac73eca936629445f8ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/l 2023-07-24 07:06:36,740 DEBUG [StoreOpener-12db6da8a942ac73eca936629445f8ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/l 2023-07-24 07:06:36,741 INFO [StoreOpener-12db6da8a942ac73eca936629445f8ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12db6da8a942ac73eca936629445f8ac columnFamilyName l 2023-07-24 07:06:36,742 INFO [StoreOpener-12db6da8a942ac73eca936629445f8ac-1] regionserver.HStore(310): Store=12db6da8a942ac73eca936629445f8ac/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:36,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,753 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:06:36,762 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:36,764 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 12db6da8a942ac73eca936629445f8ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58925405, jitterRate=-0.12194304168224335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:36,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 12db6da8a942ac73eca936629445f8ac: 2023-07-24 07:06:36,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac., pid=11, masterSystemTime=1690182396723 2023-07-24 07:06:36,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,779 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:06:36,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=12db6da8a942ac73eca936629445f8ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:36,783 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690182396783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182396783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182396783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182396783"}]},"ts":"1690182396783"} 2023-07-24 07:06:36,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 07:06:36,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 12db6da8a942ac73eca936629445f8ac, server=jenkins-hbase4.apache.org,35087,1690182392228 in 219 msec 2023-07-24 07:06:36,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 07:06:36,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=12db6da8a942ac73eca936629445f8ac, ASSIGN in 392 msec 2023-07-24 07:06:36,797 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:06:36,798 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182396797"}]},"ts":"1690182396797"} 2023-07-24 07:06:36,801 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 07:06:36,805 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:06:36,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 612 msec 2023-07-24 07:06:36,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 07:06:36,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 07:06:36,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 07:06:37,614 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:37,997 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:38,003 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34099_jobhistory____7r5vso/webapp 2023-07-24 07:06:38,174 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 07:06:38,174 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:38,174 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:38,177 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:38,252 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:38,592 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:38,965 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 07:06:39,005 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34099 2023-07-24 07:06:40,480 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:06:40,589 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 07:06:40,591 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 07:06:40,592 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 07:06:40,606 WARN [Listener at jenkins-hbase4.apache.org/38431] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:40,904 WARN [Listener at jenkins-hbase4.apache.org/38431] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 07:06:40,905 INFO [Listener at jenkins-hbase4.apache.org/38431] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:40,914 INFO [Listener at jenkins-hbase4.apache.org/38431] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39845_cluster____.i0bzdb/webapp 2023-07-24 07:06:40,978 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:40,978 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 07:06:40,979 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:40,979 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 07:06:40,979 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 07:06:40,979 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 07:06:40,979 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:06:40,979 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 07:06:40,979 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 07:06:40,979 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 07:06:40,994 INFO [Listener at jenkins-hbase4.apache.org/38431] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:40,995 INFO [Listener at jenkins-hbase4.apache.org/38431] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 07:06:40,995 INFO [Listener at jenkins-hbase4.apache.org/38431] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:40,996 INFO [Listener at jenkins-hbase4.apache.org/38431] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:41,008 INFO [Listener at jenkins-hbase4.apache.org/38431] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,187 INFO [Listener at jenkins-hbase4.apache.org/38431] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,316 INFO [Listener at jenkins-hbase4.apache.org/38431] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,326 INFO [Listener at jenkins-hbase4.apache.org/38431] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39845 2023-07-24 07:06:41,796 WARN [Listener at jenkins-hbase4.apache.org/36891] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:41,823 WARN [Listener at jenkins-hbase4.apache.org/36891] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 07:06:41,824 INFO [Listener at jenkins-hbase4.apache.org/36891] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:41,830 INFO [Listener at jenkins-hbase4.apache.org/36891] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38847_node____yz0ad0/webapp 2023-07-24 07:06:41,886 INFO [Listener at jenkins-hbase4.apache.org/36891] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 07:06:41,886 INFO [Listener at jenkins-hbase4.apache.org/36891] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:41,886 INFO [Listener at jenkins-hbase4.apache.org/36891] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:41,886 INFO [Listener at jenkins-hbase4.apache.org/36891] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:41,895 INFO [Listener at jenkins-hbase4.apache.org/36891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,918 INFO [Listener at jenkins-hbase4.apache.org/36891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:41,999 INFO [Listener at jenkins-hbase4.apache.org/36891] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:42,013 INFO [Listener at jenkins-hbase4.apache.org/36891] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38847 2023-07-24 07:06:42,207 WARN [Listener at jenkins-hbase4.apache.org/46799] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 07:06:42,212 WARN [Listener at jenkins-hbase4.apache.org/46799] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 07:06:42,213 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 07:06:42,218 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34045_node____.v6vh1u/webapp 2023-07-24 07:06:42,286 INFO [Listener at jenkins-hbase4.apache.org/46799] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 07:06:42,286 INFO [Listener at jenkins-hbase4.apache.org/46799] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 07:06:42,286 INFO [Listener at jenkins-hbase4.apache.org/46799] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 07:06:42,286 INFO [Listener at jenkins-hbase4.apache.org/46799] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 07:06:42,293 INFO [Listener at jenkins-hbase4.apache.org/46799] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:42,305 INFO [Listener at jenkins-hbase4.apache.org/46799] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:42,365 INFO [Listener at jenkins-hbase4.apache.org/46799] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 07:06:42,375 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34045 2023-07-24 07:06:42,398 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 07:06:42,400 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:42,488 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=173, AvailableMemoryMB=7846 2023-07-24 07:06:42,488 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-24 07:06:42,503 DEBUG [Listener at jenkins-hbase4.apache.org/46799] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 07:06:42,509 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 07:06:42,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 07:06:42,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:06:42,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:06:42,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 07:06:42,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:42,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:06:42,532 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:42,532 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:42,535 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 empty. 2023-07-24 07:06:42,535 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb empty. 2023-07-24 07:06:42,536 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:42,536 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:42,536 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 07:06:42,597 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 07:06:42,600 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => b08f7efd1b46a857d5b2aaf27c62a5eb, NAME => 'testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:06:42,600 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7f5c6c47859c65ad676d1fc89e886442, NAME => 'testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:06:42,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:42,650 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:42,652 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing b08f7efd1b46a857d5b2aaf27c62a5eb, disabling compactions & flushes 2023-07-24 07:06:42,652 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:42,652 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:42,652 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. after waiting 0 ms 2023-07-24 07:06:42,652 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:42,653 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:42,653 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for b08f7efd1b46a857d5b2aaf27c62a5eb: 2023-07-24 07:06:42,660 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:42,660 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 7f5c6c47859c65ad676d1fc89e886442, disabling compactions & flushes 2023-07-24 07:06:42,660 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:42,660 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:42,660 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. after waiting 0 ms 2023-07-24 07:06:42,660 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:42,660 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:42,660 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 7f5c6c47859c65ad676d1fc89e886442: 2023-07-24 07:06:42,664 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:06:42,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182402665"}]},"ts":"1690182402665"} 2023-07-24 07:06:42,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182402665"}]},"ts":"1690182402665"} 2023-07-24 07:06:42,716 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:06:42,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:06:42,718 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182402718"}]},"ts":"1690182402718"} 2023-07-24 07:06:42,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 07:06:42,726 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:06:42,728 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:06:42,728 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:06:42,728 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:06:42,728 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:06:42,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, ASSIGN}] 2023-07-24 07:06:42,732 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, ASSIGN 2023-07-24 07:06:42,732 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, ASSIGN 2023-07-24 07:06:42,735 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35087,1690182392228; forceNewPlan=false, retain=false 2023-07-24 07:06:42,735 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:06:42,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:42,885 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:06:42,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7f5c6c47859c65ad676d1fc89e886442, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:42,888 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b08f7efd1b46a857d5b2aaf27c62a5eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:42,888 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182402888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182402888"}]},"ts":"1690182402888"} 2023-07-24 07:06:42,888 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182402888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182402888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182402888"}]},"ts":"1690182402888"} 2023-07-24 07:06:42,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 7f5c6c47859c65ad676d1fc89e886442, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:06:42,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure b08f7efd1b46a857d5b2aaf27c62a5eb, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:06:43,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:43,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f5c6c47859c65ad676d1fc89e886442, NAME => 'testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:06:43,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. service=AccessControlService 2023-07-24 07:06:43,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:43,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:43,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:43,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b08f7efd1b46a857d5b2aaf27c62a5eb, NAME => 'testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:06:43,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. service=AccessControlService 2023-07-24 07:06:43,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:06:43,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:06:43,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,057 INFO [StoreOpener-7f5c6c47859c65ad676d1fc89e886442-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,057 INFO [StoreOpener-b08f7efd1b46a857d5b2aaf27c62a5eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,060 DEBUG [StoreOpener-b08f7efd1b46a857d5b2aaf27c62a5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf 2023-07-24 07:06:43,060 DEBUG [StoreOpener-7f5c6c47859c65ad676d1fc89e886442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf 2023-07-24 07:06:43,060 DEBUG [StoreOpener-7f5c6c47859c65ad676d1fc89e886442-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf 2023-07-24 07:06:43,060 DEBUG [StoreOpener-b08f7efd1b46a857d5b2aaf27c62a5eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf 2023-07-24 07:06:43,065 INFO [StoreOpener-7f5c6c47859c65ad676d1fc89e886442-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f5c6c47859c65ad676d1fc89e886442 columnFamilyName cf 2023-07-24 07:06:43,065 INFO [StoreOpener-b08f7efd1b46a857d5b2aaf27c62a5eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b08f7efd1b46a857d5b2aaf27c62a5eb columnFamilyName cf 2023-07-24 07:06:43,069 INFO [StoreOpener-b08f7efd1b46a857d5b2aaf27c62a5eb-1] regionserver.HStore(310): Store=b08f7efd1b46a857d5b2aaf27c62a5eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:43,069 INFO [StoreOpener-7f5c6c47859c65ad676d1fc89e886442-1] regionserver.HStore(310): Store=7f5c6c47859c65ad676d1fc89e886442/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:06:43,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:06:43,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:43,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b08f7efd1b46a857d5b2aaf27c62a5eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73616049, jitterRate=0.09696461260318756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:43,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b08f7efd1b46a857d5b2aaf27c62a5eb: 2023-07-24 07:06:43,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:06:43,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb., pid=16, masterSystemTime=1690182403045 2023-07-24 07:06:43,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:43,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:43,102 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b08f7efd1b46a857d5b2aaf27c62a5eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,103 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182403102"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182403102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182403102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182403102"}]},"ts":"1690182403102"} 2023-07-24 07:06:43,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 07:06:43,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure b08f7efd1b46a857d5b2aaf27c62a5eb, server=jenkins-hbase4.apache.org,44417,1690182392314 in 214 msec 2023-07-24 07:06:43,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, ASSIGN in 389 msec 2023-07-24 07:06:43,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:06:43,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7f5c6c47859c65ad676d1fc89e886442; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69495043, jitterRate=0.03555683791637421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:06:43,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7f5c6c47859c65ad676d1fc89e886442: 2023-07-24 07:06:43,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:43,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442., pid=15, masterSystemTime=1690182403044 2023-07-24 07:06:43,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:43,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:43,149 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7f5c6c47859c65ad676d1fc89e886442, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,149 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182403149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182403149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182403149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182403149"}]},"ts":"1690182403149"} 2023-07-24 07:06:43,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 07:06:43,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 7f5c6c47859c65ad676d1fc89e886442, server=jenkins-hbase4.apache.org,35087,1690182392228 in 261 msec 2023-07-24 07:06:43,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 07:06:43,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, ASSIGN in 427 msec 2023-07-24 07:06:43,169 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:06:43,171 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182403170"}]},"ts":"1690182403170"} 2023-07-24 07:06:43,174 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 07:06:43,179 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:06:43,184 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 07:06:43,191 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,195 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,200 DEBUG [hconnection-0x4aad756-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,203 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,211 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 07:06:43,249 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:43,249 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:43,249 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:43,249 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:06:43,249 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:43,259 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:06:43,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:43,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:43,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:43,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 07:06:43,272 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 750 msec 2023-07-24 07:06:43,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 07:06:43,647 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 07:06:43,653 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 07:06:43,654 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:43,657 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:43,691 DEBUG [hconnection-0x41cd982-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,697 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,712 DEBUG [hconnection-0x41cd982-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,716 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:43,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182403731 (current time:1690182403731). 2023-07-24 07:06:43,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:06:43,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x0aba1a48 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:43,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76abbdc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:43,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,747 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0aba1a48 to 127.0.0.1:60170 2023-07-24 07:06:43,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:43,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x45340fcf to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:43,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26c94b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:43,763 DEBUG [hconnection-0x184a9d21-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,764 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:43,773 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:43,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45340fcf to 127.0.0.1:60170 2023-07-24 07:06:43,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:43,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 07:06:43,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:06:43,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:43,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:43,831 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:43,833 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690183003833 2023-07-24 07:06:43,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:43,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 07:06:43,838 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:43,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:43,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-24 07:06:43,841 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:43,842 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690183003842 2023-07-24 07:06:43,842 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:06:43,843 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:06:43,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,866 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 07:06:43,867 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,868 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 07:06:43,868 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 07:06:43,868 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,868 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,872 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:43,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:43,873 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,873 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,874 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,874 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:06:43,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 07:06:43,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 07:06:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 07:06:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:43,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:43,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:43,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:43,880 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,881 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:43,881 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:43,881 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:43,881 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:43,882 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,882 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:43,882 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:43,883 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:43,888 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,888 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,888 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,888 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,889 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,889 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,889 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:43,889 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,889 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,891 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,891 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:43,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:43,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68555b37[Count = 1] remaining members to acquire global barrier 2023-07-24 07:06:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:43,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68555b37[Count = 0] remaining members to acquire global barrier 2023-07-24 07:06:43,900 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 07:06:43,900 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,903 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,903 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:43,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,904 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:43,905 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,905 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:06:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:43,907 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:43,907 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:43,907 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. started... 2023-07-24 07:06:43,910 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:43,910 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:43,911 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:06:43,918 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:43,919 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:43,920 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:43,920 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. started... 2023-07-24 07:06:43,920 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:43,920 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,920 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:43,923 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f5c6c47859c65ad676d1fc89e886442: 2023-07-24 07:06:43,923 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b08f7efd1b46a857d5b2aaf27c62a5eb: 2023-07-24 07:06:43,925 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,925 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,931 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:43,931 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:43,935 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:06:43,935 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:06:43,943 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:43,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:43,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:43,948 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:06:43,978 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. completed. 2023-07-24 07:06:43,978 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:43,979 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:06:43,982 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. completed. 2023-07-24 07:06:43,982 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:43,982 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:43,982 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:43,982 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,982 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:43,982 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:06:43,983 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,983 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,983 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,983 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:43,985 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,986 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:43,986 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:43,986 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:43,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35087,1690182392228': 2023-07-24 07:06:43,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 07:06:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:44,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:06:44,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 07:06:44,003 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 07:06:44,003 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:06:44,004 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:06:44,004 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,004 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:06:44,007 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,007 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,008 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:44,007 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:44,008 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:44,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:44,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:44,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,010 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:44,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,013 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:44,013 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,016 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,017 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,017 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:44,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,033 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:44,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:44,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:44,033 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 07:06:44,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:06:44,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:44,035 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,036 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:44,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 07:06:44,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:44,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,149 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:44,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:44,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:44,152 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:06:44,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 07:06:44,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,198 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 07:06:44,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690182403834Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690182404068 (+234 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690182404068Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690182404068Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690182404086 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690182404121 (+35 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690182404197 (+76 ms) 2023-07-24 07:06:44,202 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:44,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 366 msec 2023-07-24 07:06:44,452 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:44,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:44,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:06:44,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35087] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:06:44,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44417] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:06:44,482 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 07:06:44,482 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:44,482 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:06:44,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182404509 (current time:1690182404509). 2023-07-24 07:06:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:06:44,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x0ecf9cb6 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:44,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ef01cfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:44,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:44,557 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:44,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ecf9cb6 to 127.0.0.1:60170 2023-07-24 07:06:44,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:44,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x78d58c78 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:06:44,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a0d85f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:06:44,611 DEBUG [hconnection-0x14844f8f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:44,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:44,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:06:44,627 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:06:44,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78d58c78 to 127.0.0.1:60170 2023-07-24 07:06:44,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:06:44,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 07:06:44,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:06:44,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:44,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:44,636 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:44,638 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690183004638 2023-07-24 07:06:44,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 07:06:44,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 07:06:44,640 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:06:44,640 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:06:44,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:44,641 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 07:06:44,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-24 07:06:44,645 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:44,646 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690183004646 2023-07-24 07:06:44,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 07:06:44,678 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 07:06:44,678 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:44,680 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 07:06:44,680 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 07:06:44,680 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,680 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,683 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:44,683 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:44,683 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:44,683 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:44,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:44,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:44,683 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:44,683 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,684 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 07:06:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:44,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 07:06:44,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 07:06:44,685 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:44,685 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:44,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 07:06:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:44,688 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:44,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 07:06:44,691 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 07:06:44,692 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:44,692 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:44,692 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:06:44,692 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 07:06:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 07:06:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 07:06:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,694 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,694 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:44,695 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,695 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:44,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:44,696 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,696 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,696 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,696 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:44,696 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,696 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:06:44,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:44,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:44,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43461673[Count = 1] remaining members to acquire global barrier 2023-07-24 07:06:44,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:44,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:44,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:44,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:44,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:44,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:44,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:44,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 07:06:44,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43461673[Count = 0] remaining members to acquire global barrier 2023-07-24 07:06:44,701 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 07:06:44,701 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,707 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,707 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:44,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:44,708 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:44,708 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:06:44,708 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:44,709 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. started... 2023-07-24 07:06:44,709 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:44,709 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:06:44,709 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b08f7efd1b46a857d5b2aaf27c62a5eb 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 07:06:44,709 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 07:06:44,710 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:06:44,712 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:06:44,712 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:44,712 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:44,726 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. started... 2023-07-24 07:06:44,727 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:44,727 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:44,728 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7f5c6c47859c65ad676d1fc89e886442 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 07:06:44,740 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:44,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:44,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:44,742 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:06:44,894 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072456bae84c6f2e478e9914f926dc8d6182 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072456bae84c6f2e478e9914f926dc8d6182 2023-07-24 07:06:44,934 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/.tmp/cf/e4afcfc88af64fe3b0dda0b4b70567e1 2023-07-24 07:06:44,942 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:44,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:44,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:44,946 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:06:44,948 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/.tmp/cf/e4afcfc88af64fe3b0dda0b4b70567e1 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf/e4afcfc88af64fe3b0dda0b4b70567e1 2023-07-24 07:06:44,958 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf/e4afcfc88af64fe3b0dda0b4b70567e1, entries=48, sequenceid=6, filesize=13.0 K 2023-07-24 07:06:44,961 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for b08f7efd1b46a857d5b2aaf27c62a5eb in 252ms, sequenceid=6, compaction requested=false 2023-07-24 07:06:44,961 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 07:06:44,962 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b08f7efd1b46a857d5b2aaf27c62a5eb: 2023-07-24 07:06:44,962 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:44,963 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:44,963 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf/e4afcfc88af64fe3b0dda0b4b70567e1] hfiles 2023-07-24 07:06:44,963 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf/e4afcfc88af64fe3b0dda0b4b70567e1 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:45,019 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. completed. 2023-07-24 07:06:45,019 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:06:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:45,021 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:06:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:45,024 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:45,024 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:45,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 07:06:45,242 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724544de18a395e44f9976226ee0d510b35 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724544de18a395e44f9976226ee0d510b35 2023-07-24 07:06:45,247 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:45,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:45,250 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 07:06:45,663 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/.tmp/cf/3ff2c0c1c3744fa4bb07bcf27db60adf 2023-07-24 07:06:45,672 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/.tmp/cf/3ff2c0c1c3744fa4bb07bcf27db60adf as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf/3ff2c0c1c3744fa4bb07bcf27db60adf 2023-07-24 07:06:45,681 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf/3ff2c0c1c3744fa4bb07bcf27db60adf, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 07:06:45,684 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 7f5c6c47859c65ad676d1fc89e886442 in 956ms, sequenceid=6, compaction requested=false 2023-07-24 07:06:45,686 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f5c6c47859c65ad676d1fc89e886442: 2023-07-24 07:06:45,686 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:45,686 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:06:45,687 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf/3ff2c0c1c3744fa4bb07bcf27db60adf] hfiles 2023-07-24 07:06:45,687 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf/3ff2c0c1c3744fa4bb07bcf27db60adf for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:45,708 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. completed. 2023-07-24 07:06:45,709 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:06:45,709 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:06:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:06:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 07:06:45,710 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:06:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 07:06:45,712 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,712 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,713 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 07:06:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35087,1690182392228': 2023-07-24 07:06:45,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 07:06:45,721 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 07:06:45,721 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:06:45,721 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:06:45,721 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 07:06:45,721 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:06:45,724 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,724 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,724 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,724 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:06:45,724 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:45,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,724 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,725 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:06:45,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:45,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:45,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:45,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:45,727 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:06:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,730 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,731 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:06:45,743 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 07:06:45,744 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,745 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,751 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:45,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:45,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:06:45,760 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:45,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:45,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:45,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:06:45,761 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:06:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:06:45,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:45,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:45,761 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 07:06:45,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 07:06:45,761 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:06:45,764 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:06:45,764 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 07:06:45,764 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:06:45,764 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,765 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:06:45,765 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,765 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:06:45,765 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:06:45,765 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,765 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072456bae84c6f2e478e9914f926dc8d6182, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724544de18a395e44f9976226ee0d510b35] mob files 2023-07-24 07:06:45,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072456bae84c6f2e478e9914f926dc8d6182 2023-07-24 07:06:45,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724544de18a395e44f9976226ee0d510b35 2023-07-24 07:06:45,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 07:06:45,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 07:06:45,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,880 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 07:06:45,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690182404638Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690182405797 (+1159 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690182405797Loading Region manifests for snaptb0-testExportWithTargetName at 1690182405798 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690182405804 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690182405821 (+17 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690182405879 (+58 ms) 2023-07-24 07:06:45,882 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 07:06:45,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.2440 sec 2023-07-24 07:06:46,763 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:06:46,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 07:06:46,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:06:46,769 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769 2023-07-24 07:06:46,770 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38471, tgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769, rawTgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:06:46,835 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:06:46,835 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-869517371_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 07:06:46,835 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 07:06:46,884 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 07:06:47,006 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,007 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,007 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,008 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,008 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,009 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,009 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,103 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-2671598443394183150.jar 2023-07-24 07:06:47,104 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,104 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,105 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,106 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,106 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,107 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:06:47,107 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:06:47,108 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:06:47,109 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:06:47,110 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:06:47,110 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:06:47,111 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:06:47,112 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:06:47,112 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:06:47,113 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:06:47,113 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:06:47,117 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:47,118 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:47,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:06:47,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:47,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:06:47,120 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:06:47,121 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:06:48,119 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:06:48,144 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 07:06:48,156 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 07:06:48,588 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:06:48,760 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:06:48,760 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:06:49,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0001_000001 (auth:SIMPLE) 2023-07-24 07:06:54,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0001_000001 (auth:SIMPLE) 2023-07-24 07:06:56,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0001_000001 (auth:SIMPLE) 2023-07-24 07:07:00,419 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0001_000001 (auth:SIMPLE) 2023-07-24 07:07:02,104 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:02,106 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:02,118 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 07:07:02,118 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:02,119 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 07:07:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 07:07:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 07:07:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769/.hbase-snapshot/testExportWithTargetName 2023-07-24 07:07:02,120 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 07:07:02,120 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182406769/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 07:07:02,132 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 07:07:02,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 07:07:02,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,150 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182422150"}]},"ts":"1690182422150"} 2023-07-24 07:07:02,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 07:07:02,152 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 07:07:02,154 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 07:07:02,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, UNASSIGN}] 2023-07-24 07:07:02,159 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, UNASSIGN 2023-07-24 07:07:02,159 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, UNASSIGN 2023-07-24 07:07:02,160 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=7f5c6c47859c65ad676d1fc89e886442, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:02,160 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b08f7efd1b46a857d5b2aaf27c62a5eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:02,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182422160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182422160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182422160"}]},"ts":"1690182422160"} 2023-07-24 07:07:02,160 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182422160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182422160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182422160"}]},"ts":"1690182422160"} 2023-07-24 07:07:02,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 7f5c6c47859c65ad676d1fc89e886442, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:07:02,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure b08f7efd1b46a857d5b2aaf27c62a5eb, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:02,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 07:07:02,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:07:02,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7f5c6c47859c65ad676d1fc89e886442, disabling compactions & flushes 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b08f7efd1b46a857d5b2aaf27c62a5eb, disabling compactions & flushes 2023-07-24 07:07:02,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:07:02,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. after waiting 0 ms 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. after waiting 0 ms 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:07:02,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:07:02,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:02,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:02,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:02,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:02,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442. 2023-07-24 07:07:02,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb. 2023-07-24 07:07:02,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7f5c6c47859c65ad676d1fc89e886442: 2023-07-24 07:07:02,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b08f7efd1b46a857d5b2aaf27c62a5eb: 2023-07-24 07:07:02,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:07:02,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b08f7efd1b46a857d5b2aaf27c62a5eb, regionState=CLOSED 2023-07-24 07:07:02,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:07:02,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182422347"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182422347"}]},"ts":"1690182422347"} 2023-07-24 07:07:02,348 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=7f5c6c47859c65ad676d1fc89e886442, regionState=CLOSED 2023-07-24 07:07:02,348 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690182422348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182422348"}]},"ts":"1690182422348"} 2023-07-24 07:07:02,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 07:07:02,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure b08f7efd1b46a857d5b2aaf27c62a5eb, server=jenkins-hbase4.apache.org,44417,1690182392314 in 186 msec 2023-07-24 07:07:02,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 07:07:02,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 7f5c6c47859c65ad676d1fc89e886442, server=jenkins-hbase4.apache.org,35087,1690182392228 in 189 msec 2023-07-24 07:07:02,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b08f7efd1b46a857d5b2aaf27c62a5eb, UNASSIGN in 197 msec 2023-07-24 07:07:02,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 07:07:02,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7f5c6c47859c65ad676d1fc89e886442, UNASSIGN in 198 msec 2023-07-24 07:07:02,357 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182422357"}]},"ts":"1690182422357"} 2023-07-24 07:07:02,359 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 07:07:02,361 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 07:07:02,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-07-24 07:07:02,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 07:07:02,454 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 07:07:02,459 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 07:07:02,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,469 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 07:07:02,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,474 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 07:07:02,477 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:07:02,477 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:07:02,478 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:07:02,478 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:07:02,479 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:07:02,478 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 07:07:02,480 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:02,480 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:02,480 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:02,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:07:02,481 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:02,481 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:07:02,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:07:02,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:07:02,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 07:07:02,481 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:07:02,481 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:07:02,481 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:07:02,481 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/recovered.edits] 2023-07-24 07:07:02,481 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/recovered.edits] 2023-07-24 07:07:02,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 07:07:02,490 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf/3ff2c0c1c3744fa4bb07bcf27db60adf to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/cf/3ff2c0c1c3744fa4bb07bcf27db60adf 2023-07-24 07:07:02,490 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf/e4afcfc88af64fe3b0dda0b4b70567e1 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/cf/e4afcfc88af64fe3b0dda0b4b70567e1 2023-07-24 07:07:02,494 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442/recovered.edits/9.seqid 2023-07-24 07:07:02,494 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb/recovered.edits/9.seqid 2023-07-24 07:07:02,495 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/7f5c6c47859c65ad676d1fc89e886442 2023-07-24 07:07:02,495 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportWithTargetName/b08f7efd1b46a857d5b2aaf27c62a5eb 2023-07-24 07:07:02,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 07:07:02,496 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 07:07:02,497 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 07:07:02,501 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072456bae84c6f2e478e9914f926dc8d6182 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072456bae84c6f2e478e9914f926dc8d6182 2023-07-24 07:07:02,502 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724544de18a395e44f9976226ee0d510b35 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724544de18a395e44f9976226ee0d510b35 2023-07-24 07:07:02,503 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 07:07:02,506 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,529 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 07:07:02,532 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 07:07:02,534 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,534 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 07:07:02,534 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182422534"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:02,534 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182422534"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:02,537 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:07:02,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7f5c6c47859c65ad676d1fc89e886442, NAME => 'testtb-testExportWithTargetName,,1690182402516.7f5c6c47859c65ad676d1fc89e886442.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b08f7efd1b46a857d5b2aaf27c62a5eb, NAME => 'testtb-testExportWithTargetName,1,1690182402516.b08f7efd1b46a857d5b2aaf27c62a5eb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:07:02,537 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 07:07:02,537 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182422537"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:02,539 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 07:07:02,541 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 07:07:02,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-07-24 07:07:02,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 07:07:02,588 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 07:07:02,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 07:07:02,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 07:07:02,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 07:07:02,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 07:07:02,657 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 706) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:46799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:56104 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:40528 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:37394 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:46737 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1359983543_1 at /127.0.0.1:48426 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:35055 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=269 (was 195) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6032 (was 7846) 2023-07-24 07:07:02,657 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-24 07:07:02,680 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=269, ProcessCount=179, AvailableMemoryMB=6030 2023-07-24 07:07:02,680 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-24 07:07:02,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 07:07:02,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:02,687 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:02,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 07:07:02,689 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:02,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:07:02,692 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:02,692 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:02,693 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 empty. 2023-07-24 07:07:02,693 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 empty. 2023-07-24 07:07:02,693 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:02,693 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:02,693 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 07:07:02,708 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:02,709 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 168bf7d291e1b1cc41b9405a13277dd3, NAME => 'testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:02,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb9496ea9dfb248d4e265495272e5cc4, NAME => 'testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:02,724 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:02,725 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 168bf7d291e1b1cc41b9405a13277dd3, disabling compactions & flushes 2023-07-24 07:07:02,725 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:02,725 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:02,725 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. after waiting 0 ms 2023-07-24 07:07:02,725 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:02,725 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:02,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 168bf7d291e1b1cc41b9405a13277dd3: 2023-07-24 07:07:02,728 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:02,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing bb9496ea9dfb248d4e265495272e5cc4, disabling compactions & flushes 2023-07-24 07:07:02,729 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:02,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:02,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. after waiting 0 ms 2023-07-24 07:07:02,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:02,729 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:02,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for bb9496ea9dfb248d4e265495272e5cc4: 2023-07-24 07:07:02,732 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:02,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182422733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182422733"}]},"ts":"1690182422733"} 2023-07-24 07:07:02,733 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182422733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182422733"}]},"ts":"1690182422733"} 2023-07-24 07:07:02,736 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:02,737 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:02,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182422737"}]},"ts":"1690182422737"} 2023-07-24 07:07:02,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 07:07:02,744 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:02,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:02,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:02,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:02,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:02,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, ASSIGN}] 2023-07-24 07:07:02,749 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, ASSIGN 2023-07-24 07:07:02,749 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, ASSIGN 2023-07-24 07:07:02,750 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:07:02,750 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43877,1690182392360; forceNewPlan=false, retain=false 2023-07-24 07:07:02,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:07:02,901 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:02,903 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=168bf7d291e1b1cc41b9405a13277dd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:02,903 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bb9496ea9dfb248d4e265495272e5cc4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:02,903 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182422903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182422903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182422903"}]},"ts":"1690182422903"} 2023-07-24 07:07:02,904 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182422903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182422903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182422903"}]},"ts":"1690182422903"} 2023-07-24 07:07:02,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 168bf7d291e1b1cc41b9405a13277dd3, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:02,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure bb9496ea9dfb248d4e265495272e5cc4, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:02,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:07:03,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb9496ea9dfb248d4e265495272e5cc4, NAME => 'testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:07:03,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 168bf7d291e1b1cc41b9405a13277dd3, NAME => 'testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:07:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. service=AccessControlService 2023-07-24 07:07:03,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. service=AccessControlService 2023-07-24 07:07:03,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,080 INFO [StoreOpener-bb9496ea9dfb248d4e265495272e5cc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,080 INFO [StoreOpener-168bf7d291e1b1cc41b9405a13277dd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,082 DEBUG [StoreOpener-bb9496ea9dfb248d4e265495272e5cc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf 2023-07-24 07:07:03,082 DEBUG [StoreOpener-bb9496ea9dfb248d4e265495272e5cc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf 2023-07-24 07:07:03,082 DEBUG [StoreOpener-168bf7d291e1b1cc41b9405a13277dd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf 2023-07-24 07:07:03,082 DEBUG [StoreOpener-168bf7d291e1b1cc41b9405a13277dd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf 2023-07-24 07:07:03,083 INFO [StoreOpener-bb9496ea9dfb248d4e265495272e5cc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb9496ea9dfb248d4e265495272e5cc4 columnFamilyName cf 2023-07-24 07:07:03,083 INFO [StoreOpener-168bf7d291e1b1cc41b9405a13277dd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 168bf7d291e1b1cc41b9405a13277dd3 columnFamilyName cf 2023-07-24 07:07:03,084 INFO [StoreOpener-168bf7d291e1b1cc41b9405a13277dd3-1] regionserver.HStore(310): Store=168bf7d291e1b1cc41b9405a13277dd3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:03,084 INFO [StoreOpener-bb9496ea9dfb248d4e265495272e5cc4-1] regionserver.HStore(310): Store=bb9496ea9dfb248d4e265495272e5cc4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:03,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:03,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:03,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:03,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb9496ea9dfb248d4e265495272e5cc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66613463, jitterRate=-0.007382050156593323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:03,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb9496ea9dfb248d4e265495272e5cc4: 2023-07-24 07:07:03,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 168bf7d291e1b1cc41b9405a13277dd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60038794, jitterRate=-0.1053522527217865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:03,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 168bf7d291e1b1cc41b9405a13277dd3: 2023-07-24 07:07:03,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4., pid=31, masterSystemTime=1690182423061 2023-07-24 07:07:03,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3., pid=30, masterSystemTime=1690182423058 2023-07-24 07:07:03,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=bb9496ea9dfb248d4e265495272e5cc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182423097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182423097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182423097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182423097"}]},"ts":"1690182423097"} 2023-07-24 07:07:03,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,099 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=168bf7d291e1b1cc41b9405a13277dd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,102 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182423099"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182423099"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182423099"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182423099"}]},"ts":"1690182423099"} 2023-07-24 07:07:03,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 07:07:03,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure bb9496ea9dfb248d4e265495272e5cc4, server=jenkins-hbase4.apache.org,44417,1690182392314 in 195 msec 2023-07-24 07:07:03,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 07:07:03,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, ASSIGN in 359 msec 2023-07-24 07:07:03,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 168bf7d291e1b1cc41b9405a13277dd3, server=jenkins-hbase4.apache.org,43877,1690182392360 in 198 msec 2023-07-24 07:07:03,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 07:07:03,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, ASSIGN in 367 msec 2023-07-24 07:07:03,116 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:03,116 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182423116"}]},"ts":"1690182423116"} 2023-07-24 07:07:03,118 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 07:07:03,121 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:03,121 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 07:07:03,123 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:07:03,125 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:03,125 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:03,125 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:03,125 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:03,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:03,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:03,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:03,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:03,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 443 msec 2023-07-24 07:07:03,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 07:07:03,294 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 07:07:03,297 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 07:07:03,297 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,300 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:03,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:03,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182423314 (current time:1690182423314). 2023-07-24 07:07:03,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:03,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x30d85a52 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:03,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1456911e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:03,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:03,333 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:03,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d85a52 to 127.0.0.1:60170 2023-07-24 07:07:03,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:03,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x1892b6d4 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:03,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aea755e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:03,351 DEBUG [hconnection-0x4a94c77c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:03,355 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:03,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:03,361 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:03,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1892b6d4 to 127.0.0.1:60170 2023-07-24 07:07:03,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:03,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:07:03,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:03,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:03,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:03,368 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:03,369 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183023369 2023-07-24 07:07:03,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:03,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 07:07:03,370 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:03,370 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:03,372 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:03,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:03,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 07:07:03,374 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:03,375 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183023375 2023-07-24 07:07:03,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,389 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 07:07:03,389 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,390 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 07:07:03,390 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:07:03,391 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,391 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,393 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,393 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,393 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,393 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,393 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,394 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,394 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,394 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:03,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,395 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:03,395 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:03,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,397 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:03,397 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:03,398 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,397 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:03,397 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,399 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:03,398 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:03,407 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,407 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,407 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,407 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,407 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,407 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,408 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,408 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:03,408 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,408 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:03,408 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d5f67d6[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:03,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d5f67d6[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:03,412 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:07:03,412 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:03,414 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:03,414 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,414 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:03,414 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,414 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:03,415 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:03,415 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,415 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:03,415 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. started... 2023-07-24 07:07:03,415 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:03,415 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:03,415 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,416 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:03,416 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb9496ea9dfb248d4e265495272e5cc4: 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,415 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. started... 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 168bf7d291e1b1cc41b9405a13277dd3: 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:03,417 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:03,437 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. completed. 2023-07-24 07:07:03,437 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:03,441 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,441 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,441 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,441 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,443 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. completed. 2023-07-24 07:07:03,443 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:03,443 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,446 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,446 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,446 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,446 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:03,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:03,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:07:03,453 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 07:07:03,453 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:03,453 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:03,453 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,453 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:03,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,455 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,456 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,456 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,457 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,457 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,460 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,460 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,460 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,463 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,463 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,464 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,464 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,466 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 07:07:03,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,466 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:07:03,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,466 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,466 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,467 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,467 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,467 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,467 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 07:07:03,471 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:03,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:03,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:03,472 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:03,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 07:07:03,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,526 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:03,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690182423369Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690182423477 (+108 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690182423477Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690182423477Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690182423481 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690182423493 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690182423526 (+33 ms) 2023-07-24 07:07:03,529 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:03,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 159 msec 2023-07-24 07:07:03,672 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:03,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:03,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:03,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43877] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:03,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:03,686 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 07:07:03,687 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,687 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:03,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:03,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182423701 (current time:1690182423701). 2023-07-24 07:07:03,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:03,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x35f6a490 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:03,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76da04b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:03,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:03,714 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:03,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35f6a490 to 127.0.0.1:60170 2023-07-24 07:07:03,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:03,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x019aeada to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:03,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27915776, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:03,725 DEBUG [hconnection-0x570ba8d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:03,726 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:03,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:03,733 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:03,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x019aeada to 127.0.0.1:60170 2023-07-24 07:07:03,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:03,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:07:03,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:03,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:03,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:03,739 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:03,740 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183023740 2023-07-24 07:07:03,740 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 07:07:03,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:07:03,741 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:03,742 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:03,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:03,743 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:07:03,744 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 07:07:03,745 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:03,746 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183023746 2023-07-24 07:07:03,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 07:07:03,760 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 07:07:03,760 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,761 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 07:07:03,761 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:07:03,762 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,762 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,763 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,763 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,763 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,763 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,763 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,763 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,764 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,764 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:03,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 07:07:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,765 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 07:07:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:03,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 07:07:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 07:07:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:03,768 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:03,768 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:03,768 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:03,767 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:03,768 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:03,769 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 07:07:03,769 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 07:07:03,769 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 07:07:03,771 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,771 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,772 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,772 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b4cfe12[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 07:07:03,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b4cfe12[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:03,777 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:07:03,777 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:07:03,778 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:03,779 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:03,779 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:03,779 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,778 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:03,779 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. started... 2023-07-24 07:07:03,779 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:03,779 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:03,779 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,779 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,779 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:03,779 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bb9496ea9dfb248d4e265495272e5cc4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 07:07:03,779 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. started... 2023-07-24 07:07:03,779 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 168bf7d291e1b1cc41b9405a13277dd3 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 07:07:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,780 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:03,804 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307241157c4c283d9436782d5938b8b54c1a1 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241157c4c283d9436782d5938b8b54c1a1 2023-07-24 07:07:03,805 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724c6b57655920e4021af625ca0c4f5bbc5 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724c6b57655920e4021af625ca0c4f5bbc5 2023-07-24 07:07:03,818 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/.tmp/cf/449e78d39aba40ceab3434788793ed51 2023-07-24 07:07:03,827 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/.tmp/cf/449e78d39aba40ceab3434788793ed51 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf/449e78d39aba40ceab3434788793ed51 2023-07-24 07:07:03,827 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/.tmp/cf/782e08a1af704119a48a249121bbe00f 2023-07-24 07:07:03,834 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf/449e78d39aba40ceab3434788793ed51, entries=46, sequenceid=6, filesize=12.7 K 2023-07-24 07:07:03,834 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/.tmp/cf/782e08a1af704119a48a249121bbe00f as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf/782e08a1af704119a48a249121bbe00f 2023-07-24 07:07:03,835 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for bb9496ea9dfb248d4e265495272e5cc4 in 56ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:03,835 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 07:07:03,836 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb9496ea9dfb248d4e265495272e5cc4: 2023-07-24 07:07:03,836 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:03,836 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:03,836 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf/449e78d39aba40ceab3434788793ed51] hfiles 2023-07-24 07:07:03,836 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf/449e78d39aba40ceab3434788793ed51 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:03,840 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf/782e08a1af704119a48a249121bbe00f, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 07:07:03,841 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 168bf7d291e1b1cc41b9405a13277dd3 in 62ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:03,843 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 168bf7d291e1b1cc41b9405a13277dd3: 2023-07-24 07:07:03,843 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:03,843 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:03,843 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:03,843 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf/782e08a1af704119a48a249121bbe00f] hfiles 2023-07-24 07:07:03,843 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf/782e08a1af704119a48a249121bbe00f for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:03,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:03,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:03,844 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:03,848 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. completed. 2023-07-24 07:07:03,848 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:03,859 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. completed. 2023-07-24 07:07:03,859 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:03,859 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:03,859 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,859 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,859 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:03,860 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:03,860 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,860 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 07:07:03,859 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:03,860 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,862 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,862 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 07:07:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,862 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,863 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 07:07:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:07:03,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:07:03,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:03,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:07:03,870 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 07:07:03,870 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:03,870 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:03,870 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 07:07:03,870 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:03,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,872 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,873 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:03,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,873 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,874 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:03,875 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 07:07:03,876 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,876 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:03,879 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:03,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,880 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 07:07:03,880 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:03,880 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 07:07:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,880 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:03,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,881 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:03,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:03,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 07:07:03,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:03,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:07:03,881 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,882 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241157c4c283d9436782d5938b8b54c1a1, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724c6b57655920e4021af625ca0c4f5bbc5] mob files 2023-07-24 07:07:03,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241157c4c283d9436782d5938b8b54c1a1 2023-07-24 07:07:03,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724c6b57655920e4021af625ca0c4f5bbc5 2023-07-24 07:07:03,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 07:07:03,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 07:07:03,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,936 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:03,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690182423740Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690182423891 (+151 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690182423891Loading Region manifests for snaptb0-testExportFileSystemState at 1690182423891Writing data manifest for snaptb0-testExportFileSystemState at 1690182423895 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690182423903 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690182423936 (+33 ms) 2023-07-24 07:07:03,939 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 07:07:03,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 198 msec 2023-07-24 07:07:04,044 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:04,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:07:04,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:04,046 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046 2023-07-24 07:07:04,046 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38471, tgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046, rawTgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:04,071 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:04,071 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_690275224_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:04,071 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 07:07:04,086 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 07:07:04,523 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,524 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,524 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,525 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,525 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,526 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,526 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,624 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-4055718661645475687.jar 2023-07-24 07:07:04,625 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,625 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,625 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,626 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:04,627 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:04,627 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:04,628 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:04,628 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:04,629 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:04,629 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:04,629 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:04,630 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:04,630 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:04,631 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:04,631 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:04,631 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:04,632 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:04,632 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:04,632 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:04,633 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:04,633 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:05,644 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:05,648 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 07:07:05,651 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 07:07:06,520 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:06,520 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:06,527 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0001_000001 (auth:SIMPLE) 2023-07-24 07:07:07,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:07,992 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:07:11,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:14,223 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:17,160 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:18,889 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:18,893 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:18,902 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 07:07:18,903 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:18,903 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:18,903 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 07:07:18,904 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 07:07:18,904 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 07:07:18,904 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 07:07:18,905 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 07:07:18,905 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182424046/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 07:07:18,914 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 07:07:18,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 07:07:18,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:18,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 07:07:18,920 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182438920"}]},"ts":"1690182438920"} 2023-07-24 07:07:18,922 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 07:07:18,924 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 07:07:18,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, UNASSIGN}] 2023-07-24 07:07:18,928 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, UNASSIGN 2023-07-24 07:07:18,928 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, UNASSIGN 2023-07-24 07:07:18,929 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=168bf7d291e1b1cc41b9405a13277dd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:18,929 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb9496ea9dfb248d4e265495272e5cc4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:18,929 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182438929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182438929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182438929"}]},"ts":"1690182438929"} 2023-07-24 07:07:18,929 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182438929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182438929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182438929"}]},"ts":"1690182438929"} 2023-07-24 07:07:18,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 168bf7d291e1b1cc41b9405a13277dd3, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:18,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure bb9496ea9dfb248d4e265495272e5cc4, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:19,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 07:07:19,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:19,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 168bf7d291e1b1cc41b9405a13277dd3, disabling compactions & flushes 2023-07-24 07:07:19,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:19,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:19,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. after waiting 0 ms 2023-07-24 07:07:19,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:19,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:19,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb9496ea9dfb248d4e265495272e5cc4, disabling compactions & flushes 2023-07-24 07:07:19,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:19,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:19,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. after waiting 0 ms 2023-07-24 07:07:19,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:19,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:19,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:19,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:19,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:19,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4. 2023-07-24 07:07:19,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3. 2023-07-24 07:07:19,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb9496ea9dfb248d4e265495272e5cc4: 2023-07-24 07:07:19,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 168bf7d291e1b1cc41b9405a13277dd3: 2023-07-24 07:07:19,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:19,106 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=bb9496ea9dfb248d4e265495272e5cc4, regionState=CLOSED 2023-07-24 07:07:19,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:19,107 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182439106"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182439106"}]},"ts":"1690182439106"} 2023-07-24 07:07:19,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=168bf7d291e1b1cc41b9405a13277dd3, regionState=CLOSED 2023-07-24 07:07:19,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690182439107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182439107"}]},"ts":"1690182439107"} 2023-07-24 07:07:19,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 07:07:19,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure bb9496ea9dfb248d4e265495272e5cc4, server=jenkins-hbase4.apache.org,44417,1690182392314 in 176 msec 2023-07-24 07:07:19,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 07:07:19,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=bb9496ea9dfb248d4e265495272e5cc4, UNASSIGN in 186 msec 2023-07-24 07:07:19,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 168bf7d291e1b1cc41b9405a13277dd3, server=jenkins-hbase4.apache.org,43877,1690182392360 in 178 msec 2023-07-24 07:07:19,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-24 07:07:19,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=168bf7d291e1b1cc41b9405a13277dd3, UNASSIGN in 189 msec 2023-07-24 07:07:19,117 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182439117"}]},"ts":"1690182439117"} 2023-07-24 07:07:19,118 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 07:07:19,120 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 07:07:19,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 206 msec 2023-07-24 07:07:19,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 07:07:19,222 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 07:07:19,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 07:07:19,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:19,227 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:19,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 07:07:19,228 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:19,229 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 07:07:19,233 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:19,233 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:19,233 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,233 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,233 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,233 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:19,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:19,235 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:19,236 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/recovered.edits] 2023-07-24 07:07:19,236 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/recovered.edits] 2023-07-24 07:07:19,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 07:07:19,240 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf/449e78d39aba40ceab3434788793ed51 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/cf/449e78d39aba40ceab3434788793ed51 2023-07-24 07:07:19,240 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf/782e08a1af704119a48a249121bbe00f to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/cf/782e08a1af704119a48a249121bbe00f 2023-07-24 07:07:19,243 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4/recovered.edits/9.seqid 2023-07-24 07:07:19,244 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3/recovered.edits/9.seqid 2023-07-24 07:07:19,244 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/bb9496ea9dfb248d4e265495272e5cc4 2023-07-24 07:07:19,244 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemState/168bf7d291e1b1cc41b9405a13277dd3 2023-07-24 07:07:19,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 07:07:19,245 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 07:07:19,246 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 07:07:19,250 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241157c4c283d9436782d5938b8b54c1a1 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241157c4c283d9436782d5938b8b54c1a1 2023-07-24 07:07:19,251 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724c6b57655920e4021af625ca0c4f5bbc5 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724c6b57655920e4021af625ca0c4f5bbc5 2023-07-24 07:07:19,252 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 07:07:19,254 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:19,257 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 07:07:19,259 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 07:07:19,261 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:19,261 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 07:07:19,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182439261"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:19,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182439261"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:19,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:07:19,264 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 168bf7d291e1b1cc41b9405a13277dd3, NAME => 'testtb-testExportFileSystemState,,1690182422682.168bf7d291e1b1cc41b9405a13277dd3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb9496ea9dfb248d4e265495272e5cc4, NAME => 'testtb-testExportFileSystemState,1,1690182422682.bb9496ea9dfb248d4e265495272e5cc4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:07:19,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 07:07:19,264 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182439264"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:19,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 07:07:19,268 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 07:07:19,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-07-24 07:07:19,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 07:07:19,338 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 07:07:19,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 07:07:19,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 07:07:19,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 07:07:19,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 07:07:19,378 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 755) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:42182 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:39679 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:34102 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-48166360_1 at /127.0.0.1:42156 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:48282 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2143 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 269) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=5820 (was 6030) 2023-07-24 07:07:19,378 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 07:07:19,399 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=179, AvailableMemoryMB=5819 2023-07-24 07:07:19,399 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 07:07:19,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 07:07:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:19,405 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:19,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 07:07:19,406 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:19,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:19,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:19,409 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 2023-07-24 07:07:19,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d empty. 2023-07-24 07:07:19,410 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 empty. 2023-07-24 07:07:19,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:19,410 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 2023-07-24 07:07:19,410 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 07:07:19,424 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:19,425 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63c315628bc3b0054d9fefc05cd9bf5d, NAME => 'testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:19,425 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 524cf995da258094400000442ff2cd75, NAME => 'testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:19,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:19,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:19,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:19,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 524cf995da258094400000442ff2cd75, disabling compactions & flushes 2023-07-24 07:07:19,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 63c315628bc3b0054d9fefc05cd9bf5d, disabling compactions & flushes 2023-07-24 07:07:19,842 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:19,842 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. after waiting 0 ms 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. after waiting 0 ms 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:19,843 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:19,843 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 524cf995da258094400000442ff2cd75: 2023-07-24 07:07:19,843 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 63c315628bc3b0054d9fefc05cd9bf5d: 2023-07-24 07:07:19,846 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:19,847 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182439846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182439846"}]},"ts":"1690182439846"} 2023-07-24 07:07:19,847 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182439846"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182439846"}]},"ts":"1690182439846"} 2023-07-24 07:07:19,849 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:19,850 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:19,850 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182439850"}]},"ts":"1690182439850"} 2023-07-24 07:07:19,852 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 07:07:19,856 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:19,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:19,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:19,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:19,858 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:19,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, ASSIGN}] 2023-07-24 07:07:19,863 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, ASSIGN 2023-07-24 07:07:19,863 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, ASSIGN 2023-07-24 07:07:19,864 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43877,1690182392360; forceNewPlan=false, retain=false 2023-07-24 07:07:19,864 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:07:20,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:20,015 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:20,017 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=524cf995da258094400000442ff2cd75, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=63c315628bc3b0054d9fefc05cd9bf5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,018 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182440017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182440017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182440017"}]},"ts":"1690182440017"} 2023-07-24 07:07:20,018 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182440017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182440017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182440017"}]},"ts":"1690182440017"} 2023-07-24 07:07:20,020 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 524cf995da258094400000442ff2cd75, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:20,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 63c315628bc3b0054d9fefc05cd9bf5d, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:20,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:20,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 524cf995da258094400000442ff2cd75, NAME => 'testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:07:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. service=AccessControlService 2023-07-24 07:07:20,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:20,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63c315628bc3b0054d9fefc05cd9bf5d, NAME => 'testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:07:20,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. service=AccessControlService 2023-07-24 07:07:20,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:20,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:20,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,178 INFO [StoreOpener-524cf995da258094400000442ff2cd75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,178 INFO [StoreOpener-63c315628bc3b0054d9fefc05cd9bf5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,179 DEBUG [StoreOpener-524cf995da258094400000442ff2cd75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf 2023-07-24 07:07:20,179 DEBUG [StoreOpener-524cf995da258094400000442ff2cd75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf 2023-07-24 07:07:20,180 INFO [StoreOpener-524cf995da258094400000442ff2cd75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 524cf995da258094400000442ff2cd75 columnFamilyName cf 2023-07-24 07:07:20,180 DEBUG [StoreOpener-63c315628bc3b0054d9fefc05cd9bf5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf 2023-07-24 07:07:20,180 DEBUG [StoreOpener-63c315628bc3b0054d9fefc05cd9bf5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf 2023-07-24 07:07:20,180 INFO [StoreOpener-63c315628bc3b0054d9fefc05cd9bf5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63c315628bc3b0054d9fefc05cd9bf5d columnFamilyName cf 2023-07-24 07:07:20,181 INFO [StoreOpener-524cf995da258094400000442ff2cd75-1] regionserver.HStore(310): Store=524cf995da258094400000442ff2cd75/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:20,181 INFO [StoreOpener-63c315628bc3b0054d9fefc05cd9bf5d-1] regionserver.HStore(310): Store=63c315628bc3b0054d9fefc05cd9bf5d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:20,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 524cf995da258094400000442ff2cd75 2023-07-24 07:07:20,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:20,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:20,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:20,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 524cf995da258094400000442ff2cd75; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73687907, jitterRate=0.09803538024425507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:20,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63c315628bc3b0054d9fefc05cd9bf5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67347208, jitterRate=0.0035516023635864258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:20,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 524cf995da258094400000442ff2cd75: 2023-07-24 07:07:20,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63c315628bc3b0054d9fefc05cd9bf5d: 2023-07-24 07:07:20,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75., pid=45, masterSystemTime=1690182440172 2023-07-24 07:07:20,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d., pid=46, masterSystemTime=1690182440173 2023-07-24 07:07:20,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,193 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=63c315628bc3b0054d9fefc05cd9bf5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:20,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:20,193 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182440193"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182440193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182440193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182440193"}]},"ts":"1690182440193"} 2023-07-24 07:07:20,194 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=524cf995da258094400000442ff2cd75, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,194 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182440194"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182440194"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182440194"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182440194"}]},"ts":"1690182440194"} 2023-07-24 07:07:20,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 07:07:20,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 63c315628bc3b0054d9fefc05cd9bf5d, server=jenkins-hbase4.apache.org,44417,1690182392314 in 174 msec 2023-07-24 07:07:20,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 07:07:20,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 524cf995da258094400000442ff2cd75, server=jenkins-hbase4.apache.org,43877,1690182392360 in 176 msec 2023-07-24 07:07:20,199 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, ASSIGN in 340 msec 2023-07-24 07:07:20,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-24 07:07:20,201 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, ASSIGN in 341 msec 2023-07-24 07:07:20,203 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:20,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182440203"}]},"ts":"1690182440203"} 2023-07-24 07:07:20,205 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 07:07:20,207 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:20,208 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 07:07:20,210 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 07:07:20,211 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:20,212 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:20,212 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:20,212 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:20,214 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:20,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:20,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:20,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:20,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 813 msec 2023-07-24 07:07:20,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 07:07:20,512 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 07:07:20,515 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 07:07:20,515 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,517 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:20,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182440531 (current time:1690182440531). 2023-07-24 07:07:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x7a6dcda2 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:20,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20acd1a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:20,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:20,540 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:20,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a6dcda2 to 127.0.0.1:60170 2023-07-24 07:07:20,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:20,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x19eb61b3 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:20,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d7fbff1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:20,554 DEBUG [hconnection-0x4b981e67-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:20,556 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:20,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:20,564 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:20,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19eb61b3 to 127.0.0.1:60170 2023-07-24 07:07:20,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:20,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 07:07:20,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:20,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:20,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:20,576 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:20,577 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690183040577 2023-07-24 07:07:20,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:20,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 07:07:20,578 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:20,578 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:20,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:20,580 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:20,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-24 07:07:20,582 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:20,583 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690183040583 2023-07-24 07:07:20,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,599 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 07:07:20,599 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,600 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 07:07:20,601 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 07:07:20,601 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,601 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,602 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,602 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,602 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,602 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,603 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,603 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,604 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,604 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 07:07:20,604 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,605 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,605 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:20,608 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:20,613 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:20,613 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:20,614 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,615 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,615 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@590282af[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:20,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@590282af[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:20,621 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 07:07:20,621 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:20,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,623 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:20,624 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,624 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. started... 2023-07-24 07:07:20,624 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,624 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:20,624 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:20,624 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:20,624 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 63c315628bc3b0054d9fefc05cd9bf5d: 2023-07-24 07:07:20,624 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. started... 2023-07-24 07:07:20,625 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,627 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:20,627 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 524cf995da258094400000442ff2cd75: 2023-07-24 07:07:20,627 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:20,627 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,628 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:20,628 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:20,633 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:20,633 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:20,633 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:20,649 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. completed. 2023-07-24 07:07:20,649 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:20,649 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. completed. 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:20,649 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:20,649 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:20,651 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,651 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:20,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,651 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:20,651 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:20,651 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:20,652 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:20,653 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:20,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 07:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:20,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 07:07:20,666 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 07:07:20,666 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:20,666 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:20,666 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,666 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:20,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,669 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:20,670 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:20,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,670 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,671 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,674 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,674 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,674 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,678 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:20,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:20,678 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,681 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,678 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:20,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 07:07:20,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:07:20,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:20,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:20,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:20,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:20,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 07:07:20,683 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:20,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:20,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:20,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:20,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:20,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,753 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 07:07:20,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,754 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:20,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690182440577Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690182440698 (+121 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690182440698Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690182440698Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690182440701 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690182440715 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690182440753 (+38 ms) 2023-07-24 07:07:20,756 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:20,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 178 msec 2023-07-24 07:07:20,883 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:20,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:20,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:20,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44417] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:20,889 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43877] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:20,892 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 07:07:20,892 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,893 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:20,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:20,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182440905 (current time:1690182440905). 2023-07-24 07:07:20,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:20,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x6c3254dd to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:20,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a73b3e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:20,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:20,925 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:20,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c3254dd to 127.0.0.1:60170 2023-07-24 07:07:20,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:20,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x4353f95b to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:20,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3db9d950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:20,936 DEBUG [hconnection-0x6a0289bd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:20,939 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:20,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:20,945 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:20,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4353f95b to 127.0.0.1:60170 2023-07-24 07:07:20,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:20,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 07:07:20,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:20,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:20,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:20,952 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:20,953 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690183040953 2023-07-24 07:07:20,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 07:07:20,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 07:07:20,955 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:20,955 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:20,957 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 07:07:20,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:20,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-24 07:07:20,959 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:20,960 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690183040960 2023-07-24 07:07:20,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 07:07:20,975 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 07:07:20,975 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,977 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 07:07:20,977 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 07:07:20,978 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,978 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,981 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,981 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,981 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,981 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:20,981 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:20,981 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,982 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 07:07:20,983 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 07:07:20,983 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:20,983 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:20,983 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,983 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:20,985 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 07:07:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 07:07:20,985 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:20,987 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 07:07:20,988 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:20,989 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,989 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,989 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,990 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a84f272[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:20,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:20,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:20,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:20,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:20,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:20,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 07:07:20,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a84f272[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:20,995 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 07:07:20,995 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:20,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:20,997 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:20,997 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:20,998 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. started... 2023-07-24 07:07:20,998 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:20,998 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:20,998 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:20,998 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 07:07:20,998 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:20,998 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 524cf995da258094400000442ff2cd75 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-24 07:07:20,998 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:20,998 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. started... 2023-07-24 07:07:20,998 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:20,998 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:20,998 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 63c315628bc3b0054d9fefc05cd9bf5d 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-24 07:07:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:21,001 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:21,002 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:21,039 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724c5587f2742b94393ae4f9392f4c58622 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724c5587f2742b94393ae4f9392f4c58622 2023-07-24 07:07:21,039 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724226dc7e338a34a0992d7d46d08762517 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724226dc7e338a34a0992d7d46d08762517 2023-07-24 07:07:21,052 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/.tmp/cf/0eafc1a493a44b5d9c7caf62d0f9e324 2023-07-24 07:07:21,056 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:21,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:21,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:21,057 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:21,060 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/.tmp/cf/0eafc1a493a44b5d9c7caf62d0f9e324 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf/0eafc1a493a44b5d9c7caf62d0f9e324 2023-07-24 07:07:21,066 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf/0eafc1a493a44b5d9c7caf62d0f9e324, entries=44, sequenceid=6, filesize=12.2 K 2023-07-24 07:07:21,067 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 524cf995da258094400000442ff2cd75 in 69ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:21,067 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 07:07:21,067 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 524cf995da258094400000442ff2cd75: 2023-07-24 07:07:21,068 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:21,068 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:21,068 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf/0eafc1a493a44b5d9c7caf62d0f9e324] hfiles 2023-07-24 07:07:21,068 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf/0eafc1a493a44b5d9c7caf62d0f9e324 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:21,081 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. completed. 2023-07-24 07:07:21,081 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:21,083 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:21,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 07:07:21,257 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:21,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:21,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:21,259 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:07:21,455 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/.tmp/cf/6222021e6ae94a91bd559864b28e0468 2023-07-24 07:07:21,462 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/.tmp/cf/6222021e6ae94a91bd559864b28e0468 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf/6222021e6ae94a91bd559864b28e0468 2023-07-24 07:07:21,468 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf/6222021e6ae94a91bd559864b28e0468, entries=6, sequenceid=6, filesize=5.9 K 2023-07-24 07:07:21,469 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 63c315628bc3b0054d9fefc05cd9bf5d in 471ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:21,470 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 63c315628bc3b0054d9fefc05cd9bf5d: 2023-07-24 07:07:21,471 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:21,471 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:21,471 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf/6222021e6ae94a91bd559864b28e0468] hfiles 2023-07-24 07:07:21,471 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf/6222021e6ae94a91bd559864b28e0468 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:21,479 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. completed. 2023-07-24 07:07:21,479 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:21,479 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:21,479 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:21,479 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,479 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 07:07:21,479 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:21,482 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 07:07:21,482 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:21,482 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 07:07:21,483 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:21,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:21,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:07:21,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 07:07:21,490 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 07:07:21,490 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:21,490 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:21,490 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 07:07:21,490 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:21,492 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,492 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:21,492 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:21,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:21,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:21,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:21,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:21,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,495 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,495 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:21,496 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:21,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 07:07:21,498 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,499 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,499 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,508 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:21,508 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:21,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:21,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:21,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:21,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 07:07:21,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:21,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 07:07:21,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 07:07:21,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:07:21,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:21,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:21,509 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,511 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:21,511 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:21,511 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,511 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,509 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:21,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724226dc7e338a34a0992d7d46d08762517, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724c5587f2742b94393ae4f9392f4c58622] mob files 2023-07-24 07:07:21,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:21,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724226dc7e338a34a0992d7d46d08762517 2023-07-24 07:07:21,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724c5587f2742b94393ae4f9392f4c58622 2023-07-24 07:07:21,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 07:07:21,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,559 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:21,561 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 07:07:21,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 07:07:21,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,586 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:21,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690182440954Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690182441530 (+576 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690182441530Loading Region manifests for snaptb0-testConsecutiveExports at 1690182441530Writing data manifest for snaptb0-testConsecutiveExports at 1690182441541 (+11 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690182441552 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690182441586 (+34 ms) 2023-07-24 07:07:21,589 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 07:07:21,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 634 msec 2023-07-24 07:07:22,061 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 07:07:22,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:22,063 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063 2023-07-24 07:07:22,063 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:22,091 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:22,091 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5f88a91b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:22,091 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 07:07:22,103 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:22,120 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,121 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,122 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,122 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,123 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,123 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,123 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,199 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-8830227390604166872.jar 2023-07-24 07:07:22,200 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,200 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,201 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,201 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,201 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,202 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:22,202 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:22,202 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:22,203 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:22,203 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:22,204 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:22,204 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:22,204 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:22,205 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:22,205 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:22,205 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:22,206 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:22,206 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:22,207 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:22,207 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:22,207 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:22,207 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:22,208 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:23,351 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0002_000001 (auth:SIMPLE) 2023-07-24 07:07:23,550 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:23,553 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 07:07:23,556 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 07:07:23,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:23,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:24,356 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:24,702 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:07:28,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:31,126 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:33,607 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:34,780 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:34,781 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:34,785 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 07:07:34,785 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:34,786 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:34,786 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:34,788 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5a4b2812 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:34,790 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:34,813 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:34,813 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@289a70e5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:34,813 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 07:07:34,826 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 07:07:34,839 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,839 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,839 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,840 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,840 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,840 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,841 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,909 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-4398939886293782210.jar 2023-07-24 07:07:34,909 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,910 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,910 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,910 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,911 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,911 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:07:34,911 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:07:34,912 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:07:34,912 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:07:34,913 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:07:34,913 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:07:34,913 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:07:34,914 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:07:34,914 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:07:34,914 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:07:34,915 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:07:34,915 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:34,915 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:34,916 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:34,916 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:34,916 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:07:34,917 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:34,917 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:07:35,327 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:07:35,329 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 07:07:35,332 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 07:07:39,800 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:39,800 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:07:39,803 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0003_000001 (auth:SIMPLE) 2023-07-24 07:07:40,567 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:45,256 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:47,553 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:52,596 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:07:52,596 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:07:52,612 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 07:07:52,612 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:07:52,613 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:07:52,613 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:52,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:52,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:52,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@5a4b2812 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 07:07:52,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 07:07:52,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/local-export-1690182442063/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 07:07:52,634 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 07:07:52,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 07:07:52,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:52,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 07:07:52,641 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182472641"}]},"ts":"1690182472641"} 2023-07-24 07:07:52,645 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 07:07:52,647 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 07:07:52,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, UNASSIGN}] 2023-07-24 07:07:52,655 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, UNASSIGN 2023-07-24 07:07:52,657 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, UNASSIGN 2023-07-24 07:07:52,658 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=524cf995da258094400000442ff2cd75, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:52,658 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=63c315628bc3b0054d9fefc05cd9bf5d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:52,658 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182472657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182472657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182472657"}]},"ts":"1690182472657"} 2023-07-24 07:07:52,658 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182472658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182472658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182472658"}]},"ts":"1690182472658"} 2023-07-24 07:07:52,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 524cf995da258094400000442ff2cd75, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:52,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 63c315628bc3b0054d9fefc05cd9bf5d, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:52,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 07:07:52,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 524cf995da258094400000442ff2cd75 2023-07-24 07:07:52,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 524cf995da258094400000442ff2cd75, disabling compactions & flushes 2023-07-24 07:07:52,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:52,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:52,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. after waiting 0 ms 2023-07-24 07:07:52,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:52,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:52,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63c315628bc3b0054d9fefc05cd9bf5d, disabling compactions & flushes 2023-07-24 07:07:52,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:52,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:52,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. after waiting 0 ms 2023-07-24 07:07:52,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:52,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:52,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:07:52,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:52,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:52,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d. 2023-07-24 07:07:52,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75. 2023-07-24 07:07:52,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 524cf995da258094400000442ff2cd75: 2023-07-24 07:07:52,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63c315628bc3b0054d9fefc05cd9bf5d: 2023-07-24 07:07:52,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 524cf995da258094400000442ff2cd75 2023-07-24 07:07:52,831 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=524cf995da258094400000442ff2cd75, regionState=CLOSED 2023-07-24 07:07:52,831 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182472831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182472831"}]},"ts":"1690182472831"} 2023-07-24 07:07:52,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:52,832 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=63c315628bc3b0054d9fefc05cd9bf5d, regionState=CLOSED 2023-07-24 07:07:52,832 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690182472831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182472831"}]},"ts":"1690182472831"} 2023-07-24 07:07:52,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-24 07:07:52,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 524cf995da258094400000442ff2cd75, server=jenkins-hbase4.apache.org,43877,1690182392360 in 173 msec 2023-07-24 07:07:52,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-24 07:07:52,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 63c315628bc3b0054d9fefc05cd9bf5d, server=jenkins-hbase4.apache.org,44417,1690182392314 in 172 msec 2023-07-24 07:07:52,837 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=524cf995da258094400000442ff2cd75, UNASSIGN in 187 msec 2023-07-24 07:07:52,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-24 07:07:52,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=63c315628bc3b0054d9fefc05cd9bf5d, UNASSIGN in 187 msec 2023-07-24 07:07:52,839 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182472838"}]},"ts":"1690182472838"} 2023-07-24 07:07:52,842 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 07:07:52,843 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 07:07:52,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 209 msec 2023-07-24 07:07:52,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 07:07:52,943 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 07:07:52,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 07:07:52,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:52,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:52,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 07:07:52,949 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:52,951 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 07:07:52,955 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:52,955 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:52,955 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:52,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 07:07:52,956 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 07:07:52,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:52,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:52,957 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 2023-07-24 07:07:52,957 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:52,957 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:52,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-24 07:07:52,957 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:52,957 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:52,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-24 07:07:52,957 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:07:52,957 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 07:07:52,957 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:07:52,958 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:52,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 07:07:52,959 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/recovered.edits] 2023-07-24 07:07:52,960 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/recovered.edits] 2023-07-24 07:07:52,964 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf/6222021e6ae94a91bd559864b28e0468 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/cf/6222021e6ae94a91bd559864b28e0468 2023-07-24 07:07:52,964 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf/0eafc1a493a44b5d9c7caf62d0f9e324 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/cf/0eafc1a493a44b5d9c7caf62d0f9e324 2023-07-24 07:07:52,968 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d/recovered.edits/9.seqid 2023-07-24 07:07:52,968 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75/recovered.edits/9.seqid 2023-07-24 07:07:52,968 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/63c315628bc3b0054d9fefc05cd9bf5d 2023-07-24 07:07:52,969 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testConsecutiveExports/524cf995da258094400000442ff2cd75 2023-07-24 07:07:52,969 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 07:07:52,969 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 07:07:52,970 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 07:07:52,974 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724226dc7e338a34a0992d7d46d08762517 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724226dc7e338a34a0992d7d46d08762517 2023-07-24 07:07:52,975 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724c5587f2742b94393ae4f9392f4c58622 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724c5587f2742b94393ae4f9392f4c58622 2023-07-24 07:07:52,976 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 07:07:52,978 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:52,981 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 07:07:52,990 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 07:07:52,992 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:52,992 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 07:07:52,992 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182472992"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:52,992 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182472992"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:52,996 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:07:52,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 63c315628bc3b0054d9fefc05cd9bf5d, NAME => 'testtb-testConsecutiveExports,,1690182439401.63c315628bc3b0054d9fefc05cd9bf5d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 524cf995da258094400000442ff2cd75, NAME => 'testtb-testConsecutiveExports,1,1690182439401.524cf995da258094400000442ff2cd75.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:07:52,996 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 07:07:52,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182472996"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:52,999 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 07:07:53,002 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 07:07:53,004 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 58 msec 2023-07-24 07:07:53,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 07:07:53,061 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 07:07:53,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 07:07:53,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 07:07:53,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 07:07:53,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 07:07:53,150 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 764), OpenFileDescriptor=896 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=437 (was 294) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 179), AvailableMemoryMB=5852 (was 5819) - AvailableMemoryMB LEAK? - 2023-07-24 07:07:53,151 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-24 07:07:53,182 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=437, ProcessCount=178, AvailableMemoryMB=5840 2023-07-24 07:07:53,182 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-24 07:07:53,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 07:07:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,191 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:53,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 07:07:53,193 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:53,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:53,207 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,211 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 empty. 2023-07-24 07:07:53,211 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,212 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,212 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 empty. 2023-07-24 07:07:53,212 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,212 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 07:07:53,270 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:53,279 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf91ef21a30091c23dee9e0aafc01a38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:53,279 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 17aa90076555f47851c1da76b1a51800, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:53,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:53,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:53,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing cf91ef21a30091c23dee9e0aafc01a38, disabling compactions & flushes 2023-07-24 07:07:53,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. after waiting 0 ms 2023-07-24 07:07:53,335 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,336 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,336 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for cf91ef21a30091c23dee9e0aafc01a38: 2023-07-24 07:07:53,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:53,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 17aa90076555f47851c1da76b1a51800, disabling compactions & flushes 2023-07-24 07:07:53,343 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. after waiting 0 ms 2023-07-24 07:07:53,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,343 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,343 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 17aa90076555f47851c1da76b1a51800: 2023-07-24 07:07:53,347 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:53,348 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182473348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182473348"}]},"ts":"1690182473348"} 2023-07-24 07:07:53,348 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182473348"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182473348"}]},"ts":"1690182473348"} 2023-07-24 07:07:53,356 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:53,357 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:53,358 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182473357"}]},"ts":"1690182473357"} 2023-07-24 07:07:53,359 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 07:07:53,363 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:53,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:53,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:53,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:53,367 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:53,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, ASSIGN}] 2023-07-24 07:07:53,370 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, ASSIGN 2023-07-24 07:07:53,371 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, ASSIGN 2023-07-24 07:07:53,381 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:07:53,381 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43877,1690182392360; forceNewPlan=false, retain=false 2023-07-24 07:07:53,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:53,531 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:53,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=cf91ef21a30091c23dee9e0aafc01a38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,535 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=17aa90076555f47851c1da76b1a51800, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182473535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182473535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182473535"}]},"ts":"1690182473535"} 2023-07-24 07:07:53,535 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182473535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182473535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182473535"}]},"ts":"1690182473535"} 2023-07-24 07:07:53,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure cf91ef21a30091c23dee9e0aafc01a38, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:53,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 17aa90076555f47851c1da76b1a51800, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:53,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17aa90076555f47851c1da76b1a51800, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:07:53,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. service=AccessControlService 2023-07-24 07:07:53,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf91ef21a30091c23dee9e0aafc01a38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. service=AccessControlService 2023-07-24 07:07:53,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:53,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,701 INFO [StoreOpener-17aa90076555f47851c1da76b1a51800-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,702 INFO [StoreOpener-cf91ef21a30091c23dee9e0aafc01a38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,703 DEBUG [StoreOpener-17aa90076555f47851c1da76b1a51800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf 2023-07-24 07:07:53,703 DEBUG [StoreOpener-17aa90076555f47851c1da76b1a51800-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf 2023-07-24 07:07:53,704 DEBUG [StoreOpener-cf91ef21a30091c23dee9e0aafc01a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf 2023-07-24 07:07:53,704 DEBUG [StoreOpener-cf91ef21a30091c23dee9e0aafc01a38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf 2023-07-24 07:07:53,704 INFO [StoreOpener-17aa90076555f47851c1da76b1a51800-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17aa90076555f47851c1da76b1a51800 columnFamilyName cf 2023-07-24 07:07:53,705 INFO [StoreOpener-cf91ef21a30091c23dee9e0aafc01a38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf91ef21a30091c23dee9e0aafc01a38 columnFamilyName cf 2023-07-24 07:07:53,706 INFO [StoreOpener-17aa90076555f47851c1da76b1a51800-1] regionserver.HStore(310): Store=17aa90076555f47851c1da76b1a51800/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:53,706 INFO [StoreOpener-cf91ef21a30091c23dee9e0aafc01a38-1] regionserver.HStore(310): Store=cf91ef21a30091c23dee9e0aafc01a38/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:53,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:07:53,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:53,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf91ef21a30091c23dee9e0aafc01a38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59938251, jitterRate=-0.10685046017169952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:53,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf91ef21a30091c23dee9e0aafc01a38: 2023-07-24 07:07:53,715 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38., pid=60, masterSystemTime=1690182473694 2023-07-24 07:07:53,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 17aa90076555f47851c1da76b1a51800 2023-07-24 07:07:53,719 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=cf91ef21a30091c23dee9e0aafc01a38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,720 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182473719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182473719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182473719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182473719"}]},"ts":"1690182473719"} 2023-07-24 07:07:53,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:53,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 17aa90076555f47851c1da76b1a51800; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72465512, jitterRate=0.07982027530670166}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:53,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 17aa90076555f47851c1da76b1a51800: 2023-07-24 07:07:53,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800., pid=61, masterSystemTime=1690182473694 2023-07-24 07:07:53,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 07:07:53,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure cf91ef21a30091c23dee9e0aafc01a38, server=jenkins-hbase4.apache.org,43877,1690182392360 in 184 msec 2023-07-24 07:07:53,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,728 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=17aa90076555f47851c1da76b1a51800, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,728 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182473728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182473728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182473728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182473728"}]},"ts":"1690182473728"} 2023-07-24 07:07:53,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, ASSIGN in 360 msec 2023-07-24 07:07:53,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 07:07:53,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 17aa90076555f47851c1da76b1a51800, server=jenkins-hbase4.apache.org,44417,1690182392314 in 191 msec 2023-07-24 07:07:53,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 07:07:53,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, ASSIGN in 365 msec 2023-07-24 07:07:53,735 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:53,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182473736"}]},"ts":"1690182473736"} 2023-07-24 07:07:53,738 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 07:07:53,743 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:53,743 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 07:07:53,746 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 07:07:53,747 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:53,747 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:53,747 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:53,747 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:53,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:53,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:53,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:53,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:53,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 564 msec 2023-07-24 07:07:53,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 07:07:53,800 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 07:07:53,814 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,815 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,817 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:53,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:53,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182473842 (current time:1690182473842). 2023-07-24 07:07:53,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:53,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x4decc2ec to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:53,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@295bc540, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:53,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:53,856 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:53,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4decc2ec to 127.0.0.1:60170 2023-07-24 07:07:53,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:53,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x4427c40c to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:53,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff785c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:53,866 DEBUG [hconnection-0x18712cbd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:53,867 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:53,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:53,875 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:53,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4427c40c to 127.0.0.1:60170 2023-07-24 07:07:53,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:53,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 07:07:53,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:53,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:53,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:53,881 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:53,882 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690183073882 2023-07-24 07:07:53,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:53,884 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:53,884 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:53,888 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:53,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:53,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-24 07:07:53,894 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:53,895 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690183073895 2023-07-24 07:07:53,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,910 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 07:07:53,910 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:53,912 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 07:07:53,912 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 07:07:53,913 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,913 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,914 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:53,914 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:53,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:53,915 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:53,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:53,915 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,915 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,915 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:53,918 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:53,919 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,919 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:53,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,919 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:53,919 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:53,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 07:07:53,921 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:53,921 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:53,919 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:53,921 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:53,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,921 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:53,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:53,922 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:53,922 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:53,922 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:53,924 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,924 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,924 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:53,924 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:53,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:53,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:53,925 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:53,925 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:53,925 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:53,925 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,925 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,925 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:53,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:53,926 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,926 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:53,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:53,928 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,928 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c334123[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:53,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:53,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:53,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:53,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:53,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c334123[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:53,932 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 07:07:53,932 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:53,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,934 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:53,934 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:53,934 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:53,934 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:53,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:53,935 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:53,935 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:53,935 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:53,935 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:53,935 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. started... 2023-07-24 07:07:53,935 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:53,935 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. started... 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17aa90076555f47851c1da76b1a51800: 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf91ef21a30091c23dee9e0aafc01a38: 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:53,937 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:07:53,938 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:53,938 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:53,938 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:53,984 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:53,985 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:54,185 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:54,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:54,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:54,187 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:07:54,369 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. completed. 2023-07-24 07:07:54,369 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:54,369 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:54,369 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:54,369 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,369 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:54,369 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:54,370 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. completed. 2023-07-24 07:07:54,370 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:54,370 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:54,370 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:54,370 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,370 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:54,370 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:54,371 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:54,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:54,371 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:54,372 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:54,372 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:54,374 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:54,374 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:54,374 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:54,374 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:07:54,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 07:07:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:54,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 07:07:54,386 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 07:07:54,386 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:54,386 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:54,386 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,386 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:54,389 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:54,390 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:54,390 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,389 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:54,390 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:54,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:54,391 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,390 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:54,391 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:54,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,393 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:54,394 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,395 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:54,399 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:54,399 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:54,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:54,401 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:54,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,401 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,401 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,402 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:54,402 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,402 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:54,402 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:54,402 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:54,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:54,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,402 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:07:54,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 07:07:54,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,487 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:54,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:54,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:54,489 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 07:07:54,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 07:07:54,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,491 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:54,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690182473882Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690182474423 (+541 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182474423Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182474424 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182474433 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690182474455 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690182474490 (+35 ms) 2023-07-24 07:07:54,494 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:54,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 611 msec 2023-07-24 07:07:54,989 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:54,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:54,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:54,995 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43877] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:54,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:07:55,004 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,004 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:55,004 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:07:55,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:55,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182475017 (current time:1690182475017). 2023-07-24 07:07:55,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:55,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x339f06db to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:55,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@500244e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:55,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:55,050 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:55,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x339f06db to 127.0.0.1:60170 2023-07-24 07:07:55,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:55,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x509aa850 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:55,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b78d546, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:55,071 DEBUG [hconnection-0x591f8fb2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:55,075 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:55,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:55,084 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x509aa850 to 127.0.0.1:60170 2023-07-24 07:07:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 07:07:55,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:55,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:55,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:55,090 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:55,091 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690183075091 2023-07-24 07:07:55,091 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 07:07:55,093 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:55,093 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:55,095 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 07:07:55,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:55,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-24 07:07:55,097 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:55,099 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690183075099 2023-07-24 07:07:55,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,112 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 07:07:55,112 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:55,114 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 07:07:55,114 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 07:07:55,116 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,116 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,118 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:55,118 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:55,118 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:55,118 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:55,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:55,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:55,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,119 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,119 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,121 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,121 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:55,121 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:55,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,122 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:55,122 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:55,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 07:07:55,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 07:07:55,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,126 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:55,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,127 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:55,127 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:55,127 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:55,127 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 07:07:55,128 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:55,127 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 07:07:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 07:07:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 07:07:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,131 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:55,132 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,132 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,132 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:55,132 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:55,132 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738cd9[Count = 1] remaining members to acquire global barrier 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:55,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:55,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:55,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:55,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 07:07:55,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@738cd9[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:55,137 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 07:07:55,137 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:55,143 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:55,143 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 07:07:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:55,144 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:55,144 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,144 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:55,145 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:55,145 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:55,145 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:55,148 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:55,148 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:55,148 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:55,148 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. started... 2023-07-24 07:07:55,149 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 17aa90076555f47851c1da76b1a51800 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 07:07:55,149 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:55,149 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:55,149 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:55,149 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. started... 2023-07-24 07:07:55,150 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cf91ef21a30091c23dee9e0aafc01a38 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 07:07:55,185 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724e3c47a8a55a54111819f8a2e89ecc682 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e3c47a8a55a54111819f8a2e89ecc682 2023-07-24 07:07:55,188 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724fbbdb3c35c5d4abdb0fbba8c318c6225 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724fbbdb3c35c5d4abdb0fbba8c318c6225 2023-07-24 07:07:55,193 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:55,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:55,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:55,195 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:55,207 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/.tmp/cf/15419da24619453d864dba6647dcea5d 2023-07-24 07:07:55,213 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/.tmp/cf/15419da24619453d864dba6647dcea5d as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf/15419da24619453d864dba6647dcea5d 2023-07-24 07:07:55,218 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf/15419da24619453d864dba6647dcea5d, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 07:07:55,219 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for cf91ef21a30091c23dee9e0aafc01a38 in 70ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:55,220 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 07:07:55,220 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cf91ef21a30091c23dee9e0aafc01a38: 2023-07-24 07:07:55,220 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,221 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:55,221 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf/15419da24619453d864dba6647dcea5d] hfiles 2023-07-24 07:07:55,221 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf/15419da24619453d864dba6647dcea5d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,222 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/.tmp/cf/f277db9d579245fdae0fb789027b38f6 2023-07-24 07:07:55,228 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/.tmp/cf/f277db9d579245fdae0fb789027b38f6 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf/f277db9d579245fdae0fb789027b38f6 2023-07-24 07:07:55,243 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf/f277db9d579245fdae0fb789027b38f6, entries=46, sequenceid=6, filesize=13.3 K 2023-07-24 07:07:55,247 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 17aa90076555f47851c1da76b1a51800 in 99ms, sequenceid=6, compaction requested=false 2023-07-24 07:07:55,249 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 17aa90076555f47851c1da76b1a51800: 2023-07-24 07:07:55,249 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,249 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:55,249 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf/f277db9d579245fdae0fb789027b38f6] hfiles 2023-07-24 07:07:55,250 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf/f277db9d579245fdae0fb789027b38f6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,258 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. completed. 2023-07-24 07:07:55,259 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:07:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:55,259 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:55,261 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:55,261 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,261 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:55,261 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:55,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 07:07:55,273 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. completed. 2023-07-24 07:07:55,273 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:07:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 07:07:55,273 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 07:07:55,275 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,275 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:55,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:55,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:55,276 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 07:07:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:07:55,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 07:07:55,283 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 07:07:55,283 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:55,283 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:55,283 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,283 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:55,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:55,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,294 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,296 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,297 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:55,298 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:55,301 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,301 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,302 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,305 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,305 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:55,305 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:55,305 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,306 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:55,306 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:55,306 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:55,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:55,306 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:55,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:55,306 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:55,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,306 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:55,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:55,309 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,309 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:55,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:07:55,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:55,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:55,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:55,309 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:55,310 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,310 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:55,310 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:55,310 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,310 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724fbbdb3c35c5d4abdb0fbba8c318c6225, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e3c47a8a55a54111819f8a2e89ecc682] mob files 2023-07-24 07:07:55,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724fbbdb3c35c5d4abdb0fbba8c318c6225 2023-07-24 07:07:55,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e3c47a8a55a54111819f8a2e89ecc682 2023-07-24 07:07:55,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,395 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:55,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:55,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:55,397 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:07:55,697 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:55,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:55,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:55,699 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 07:07:55,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 07:07:55,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,855 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:07:55,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690182475091Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690182475326 (+235 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690182475326Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690182475326Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690182475334 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690182475755 (+421 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690182475855 (+100 ms) 2023-07-24 07:07:55,859 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 07:07:55,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 766 msec 2023-07-24 07:07:56,199 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:56,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 07:07:56,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:56,257 DEBUG [Listener at jenkins-hbase4.apache.org/46799] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:07:56,266 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:07:56,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35087] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 07:07:56,269 DEBUG [Listener at jenkins-hbase4.apache.org/46799] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:07:56,280 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:07:56,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43877] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 07:07:56,281 DEBUG [Listener at jenkins-hbase4.apache.org/46799] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 07:07:56,299 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 07:07:56,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44417] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 07:07:56,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 07:07:56,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:56,308 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:07:56,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 07:07:56,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:56,310 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:07:56,327 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,328 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 empty. 2023-07-24 07:07:56,330 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,335 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,335 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 empty. 2023-07-24 07:07:56,336 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,336 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 07:07:56,392 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 07:07:56,396 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7defafb03a7c1ae34fc645da6567483, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:56,400 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => d963e5ae51d50c31e57c6fcbb9c21386, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:07:56,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:56,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:56,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a7defafb03a7c1ae34fc645da6567483, disabling compactions & flushes 2023-07-24 07:07:56,438 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. after waiting 0 ms 2023-07-24 07:07:56,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,438 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a7defafb03a7c1ae34fc645da6567483: 2023-07-24 07:07:56,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:56,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing d963e5ae51d50c31e57c6fcbb9c21386, disabling compactions & flushes 2023-07-24 07:07:56,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. after waiting 0 ms 2023-07-24 07:07:56,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for d963e5ae51d50c31e57c6fcbb9c21386: 2023-07-24 07:07:56,445 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:07:56,446 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182476446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182476446"}]},"ts":"1690182476446"} 2023-07-24 07:07:56,446 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182476446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182476446"}]},"ts":"1690182476446"} 2023-07-24 07:07:56,449 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:07:56,449 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:07:56,450 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182476450"}]},"ts":"1690182476450"} 2023-07-24 07:07:56,451 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 07:07:56,454 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:07:56,456 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:07:56,456 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:07:56,456 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:07:56,456 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:07:56,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, ASSIGN}] 2023-07-24 07:07:56,459 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, ASSIGN 2023-07-24 07:07:56,459 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, ASSIGN 2023-07-24 07:07:56,460 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:07:56,460 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43877,1690182392360; forceNewPlan=false, retain=false 2023-07-24 07:07:56,610 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:07:56,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d963e5ae51d50c31e57c6fcbb9c21386, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:56,613 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a7defafb03a7c1ae34fc645da6567483, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:56,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182476613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182476613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182476613"}]},"ts":"1690182476613"} 2023-07-24 07:07:56,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182476613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182476613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182476613"}]},"ts":"1690182476613"} 2023-07-24 07:07:56,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:56,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure d963e5ae51d50c31e57c6fcbb9c21386, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:56,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a7defafb03a7c1ae34fc645da6567483, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:56,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d963e5ae51d50c31e57c6fcbb9c21386, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 07:07:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. service=AccessControlService 2023-07-24 07:07:56,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7defafb03a7c1ae34fc645da6567483, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 07:07:56,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. service=AccessControlService 2023-07-24 07:07:56,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:56,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:56,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,798 INFO [StoreOpener-d963e5ae51d50c31e57c6fcbb9c21386-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,798 INFO [StoreOpener-a7defafb03a7c1ae34fc645da6567483-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,800 DEBUG [StoreOpener-d963e5ae51d50c31e57c6fcbb9c21386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf 2023-07-24 07:07:56,800 DEBUG [StoreOpener-d963e5ae51d50c31e57c6fcbb9c21386-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf 2023-07-24 07:07:56,800 DEBUG [StoreOpener-a7defafb03a7c1ae34fc645da6567483-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf 2023-07-24 07:07:56,801 DEBUG [StoreOpener-a7defafb03a7c1ae34fc645da6567483-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf 2023-07-24 07:07:56,801 INFO [StoreOpener-d963e5ae51d50c31e57c6fcbb9c21386-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d963e5ae51d50c31e57c6fcbb9c21386 columnFamilyName cf 2023-07-24 07:07:56,801 INFO [StoreOpener-d963e5ae51d50c31e57c6fcbb9c21386-1] regionserver.HStore(310): Store=d963e5ae51d50c31e57c6fcbb9c21386/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:56,801 INFO [StoreOpener-a7defafb03a7c1ae34fc645da6567483-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7defafb03a7c1ae34fc645da6567483 columnFamilyName cf 2023-07-24 07:07:56,802 INFO [StoreOpener-a7defafb03a7c1ae34fc645da6567483-1] regionserver.HStore(310): Store=a7defafb03a7c1ae34fc645da6567483/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:56,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:56,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:56,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d963e5ae51d50c31e57c6fcbb9c21386; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61936776, jitterRate=-0.07707011699676514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:56,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d963e5ae51d50c31e57c6fcbb9c21386: 2023-07-24 07:07:56,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:07:56,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386., pid=69, masterSystemTime=1690182476768 2023-07-24 07:07:56,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7defafb03a7c1ae34fc645da6567483; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68293934, jitterRate=0.017658919095993042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:56,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7defafb03a7c1ae34fc645da6567483: 2023-07-24 07:07:56,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:56,843 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d963e5ae51d50c31e57c6fcbb9c21386, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:56,844 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182476843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182476843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182476843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182476843"}]},"ts":"1690182476843"} 2023-07-24 07:07:56,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483., pid=70, masterSystemTime=1690182476771 2023-07-24 07:07:56,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:56,854 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a7defafb03a7c1ae34fc645da6567483, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:56,854 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182476854"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182476854"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182476854"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182476854"}]},"ts":"1690182476854"} 2023-07-24 07:07:56,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 07:07:56,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure d963e5ae51d50c31e57c6fcbb9c21386, server=jenkins-hbase4.apache.org,44417,1690182392314 in 236 msec 2023-07-24 07:07:56,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, ASSIGN in 399 msec 2023-07-24 07:07:56,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 07:07:56,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a7defafb03a7c1ae34fc645da6567483, server=jenkins-hbase4.apache.org,43877,1690182392360 in 239 msec 2023-07-24 07:07:56,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 07:07:56,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, ASSIGN in 404 msec 2023-07-24 07:07:56,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:07:56,865 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182476865"}]},"ts":"1690182476865"} 2023-07-24 07:07:56,868 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 07:07:56,871 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:07:56,872 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 07:07:56,874 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 07:07:56,876 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:56,876 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:56,877 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:56,877 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:07:56,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,880 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 07:07:56,888 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 578 msec 2023-07-24 07:07:56,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 07:07:56,916 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 07:07:56,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a7defafb03a7c1ae34fc645da6567483, d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:56,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a7defafb03a7c1ae34fc645da6567483, d963e5ae51d50c31e57c6fcbb9c21386], force=true 2023-07-24 07:07:56,996 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a7defafb03a7c1ae34fc645da6567483, d963e5ae51d50c31e57c6fcbb9c21386], force=true 2023-07-24 07:07:56,996 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a7defafb03a7c1ae34fc645da6567483, d963e5ae51d50c31e57c6fcbb9c21386], force=true 2023-07-24 07:07:56,996 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a7defafb03a7c1ae34fc645da6567483, d963e5ae51d50c31e57c6fcbb9c21386], force=true 2023-07-24 07:07:57,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:57,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, UNASSIGN}] 2023-07-24 07:07:57,039 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, UNASSIGN 2023-07-24 07:07:57,039 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, UNASSIGN 2023-07-24 07:07:57,040 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a7defafb03a7c1ae34fc645da6567483, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:57,040 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d963e5ae51d50c31e57c6fcbb9c21386, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:57,040 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182477040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182477040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182477040"}]},"ts":"1690182477040"} 2023-07-24 07:07:57,040 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182477040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182477040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182477040"}]},"ts":"1690182477040"} 2023-07-24 07:07:57,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure a7defafb03a7c1ae34fc645da6567483, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:57,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure d963e5ae51d50c31e57c6fcbb9c21386, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:07:57,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:57,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:57,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7defafb03a7c1ae34fc645da6567483, disabling compactions & flushes 2023-07-24 07:07:57,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:57,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:57,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. after waiting 0 ms 2023-07-24 07:07:57,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:57,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a7defafb03a7c1ae34fc645da6567483 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 07:07:57,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:57,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d963e5ae51d50c31e57c6fcbb9c21386, disabling compactions & flushes 2023-07-24 07:07:57,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:57,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:57,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. after waiting 0 ms 2023-07-24 07:07:57,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:57,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d963e5ae51d50c31e57c6fcbb9c21386 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 07:07:57,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/.tmp/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b 2023-07-24 07:07:57,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/.tmp/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b 2023-07-24 07:07:57,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/.tmp/cf/5bcc8954c61e4597992bf16d2b2ff236 2023-07-24 07:07:57,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/.tmp/cf/5bcc8954c61e4597992bf16d2b2ff236 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf/5bcc8954c61e4597992bf16d2b2ff236 2023-07-24 07:07:57,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:57,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 07:07:57,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a7defafb03a7c1ae34fc645da6567483 in 132ms, sequenceid=5, compaction requested=false 2023-07-24 07:07:57,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 07:07:57,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf/5bcc8954c61e4597992bf16d2b2ff236, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 07:07:57,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d963e5ae51d50c31e57c6fcbb9c21386 in 133ms, sequenceid=5, compaction requested=false 2023-07-24 07:07:57,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 07:07:57,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:57,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483. 2023-07-24 07:07:57,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7defafb03a7c1ae34fc645da6567483: 2023-07-24 07:07:57,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 07:07:57,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:07:57,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386. 2023-07-24 07:07:57,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d963e5ae51d50c31e57c6fcbb9c21386: 2023-07-24 07:07:57,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:07:57,406 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a7defafb03a7c1ae34fc645da6567483, regionState=CLOSED 2023-07-24 07:07:57,406 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182477406"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182477406"}]},"ts":"1690182477406"} 2023-07-24 07:07:57,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:07:57,408 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d963e5ae51d50c31e57c6fcbb9c21386, regionState=CLOSED 2023-07-24 07:07:57,408 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690182477408"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182477408"}]},"ts":"1690182477408"} 2023-07-24 07:07:57,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 07:07:57,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure a7defafb03a7c1ae34fc645da6567483, server=jenkins-hbase4.apache.org,43877,1690182392360 in 367 msec 2023-07-24 07:07:57,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 07:07:57,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure d963e5ae51d50c31e57c6fcbb9c21386, server=jenkins-hbase4.apache.org,44417,1690182392314 in 367 msec 2023-07-24 07:07:57,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a7defafb03a7c1ae34fc645da6567483, UNASSIGN in 381 msec 2023-07-24 07:07:57,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-24 07:07:57,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d963e5ae51d50c31e57c6fcbb9c21386, UNASSIGN in 383 msec 2023-07-24 07:07:57,600 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0004_000001 (auth:SIMPLE) 2023-07-24 07:07:57,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:57,654 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 07:07:57,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476303.a7defafb03a7c1ae34fc645da6567483.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:57,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690182476303.d963e5ae51d50c31e57c6fcbb9c21386.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:57,658 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 07:07:57,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, ASSIGN}] 2023-07-24 07:07:57,767 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, ASSIGN 2023-07-24 07:07:57,768 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43877,1690182392360; forceNewPlan=false, retain=false 2023-07-24 07:07:57,918 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 07:07:57,921 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=71c8e8aa5e202447273ccc302d81774d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:57,921 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182477921"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182477921"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182477921"}]},"ts":"1690182477921"} 2023-07-24 07:07:57,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 71c8e8aa5e202447273ccc302d81774d, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:07:58,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:07:58,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 71c8e8aa5e202447273ccc302d81774d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.', STARTKEY => '', ENDKEY => ''} 2023-07-24 07:07:58,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. service=AccessControlService 2023-07-24 07:07:58,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:07:58,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:07:58,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/.regioninfo 2023-07-24 07:07:58,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:58,140 INFO [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,141 DEBUG [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf 2023-07-24 07:07:58,141 DEBUG [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf 2023-07-24 07:07:58,141 INFO [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 71c8e8aa5e202447273ccc302d81774d columnFamilyName cf 2023-07-24 07:07:58,178 DEBUG [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] regionserver.HStore(539): loaded hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/5bcc8954c61e4597992bf16d2b2ff236.d963e5ae51d50c31e57c6fcbb9c21386->hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf/5bcc8954c61e4597992bf16d2b2ff236-top 2023-07-24 07:07:58,186 DEBUG [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] regionserver.HStore(539): loaded hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b.a7defafb03a7c1ae34fc645da6567483->hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b-top 2023-07-24 07:07:58,187 INFO [StoreOpener-71c8e8aa5e202447273ccc302d81774d-1] regionserver.HStore(310): Store=71c8e8aa5e202447273ccc302d81774d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:07:58,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:07:58,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 71c8e8aa5e202447273ccc302d81774d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68082822, jitterRate=0.014513105154037476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:07:58,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 71c8e8aa5e202447273ccc302d81774d: 2023-07-24 07:07:58,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d., pid=77, masterSystemTime=1690182478076 2023-07-24 07:07:58,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.,because compaction is disabled. 2023-07-24 07:07:58,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:07:58,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:07:58,211 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=71c8e8aa5e202447273ccc302d81774d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:58,211 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182478210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182478210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182478210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182478210"}]},"ts":"1690182478210"} 2023-07-24 07:07:58,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 07:07:58,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 71c8e8aa5e202447273ccc302d81774d, server=jenkins-hbase4.apache.org,43877,1690182392360 in 289 msec 2023-07-24 07:07:58,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 07:07:58,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, ASSIGN in 459 msec 2023-07-24 07:07:58,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a7defafb03a7c1ae34fc645da6567483, d963e5ae51d50c31e57c6fcbb9c21386], force=true in 1.2370 sec 2023-07-24 07:07:58,454 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:07:59,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 07:07:59,134 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 07:07:59,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 07:07:59,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182479135 (current time:1690182479135). 2023-07-24 07:07:59,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:07:59,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x71263f1b to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:59,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@156b6317, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:59,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:59,182 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:59,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71263f1b to 127.0.0.1:60170 2023-07-24 07:07:59,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:59,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x5add74aa to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:07:59,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a43560d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:07:59,294 DEBUG [hconnection-0x547eed89-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:59,304 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:59,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:07:59,313 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:07:59,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5add74aa to 127.0.0.1:60170 2023-07-24 07:07:59,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:07:59,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 07:07:59,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:07:59,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 07:07:59,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 07:07:59,324 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 07:07:59,325 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690183079325 2023-07-24 07:07:59,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 07:07:59,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,331 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:07:59,331 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:07:59,333 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 07:07:59,342 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 07:07:59,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 24 msec 2023-07-24 07:07:59,347 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 07:07:59,349 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690183079349 2023-07-24 07:07:59,407 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,408 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 07:07:59,408 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:59,410 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 07:07:59,410 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 07:07:59,410 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,410 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,412 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:59,412 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:59,413 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:59,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:59,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:59,413 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:59,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,413 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,413 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 07:07:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 07:07:59,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 07:07:59,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 07:07:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:59,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 07:07:59,433 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:59,432 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:59,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 07:07:59,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:59,434 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:07:59,448 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 07:07:59,449 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 07:07:59,448 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 07:07:59,449 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 07:07:59,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,449 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 07:07:59,449 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 07:07:59,449 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 07:07:59,449 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:07:59,451 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 07:07:59,451 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 07:07:59,451 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 07:07:59,453 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,453 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,453 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:59,454 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,454 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:59,453 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,454 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,454 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,455 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:07:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:59,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:59,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 07:07:59,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d296182[Count = 0] remaining members to acquire global barrier 2023-07-24 07:07:59,460 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 07:07:59,460 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 07:07:59,462 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 07:07:59,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:07:59,462 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:07:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,462 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 07:07:59,463 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 07:07:59,463 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 07:07:59,463 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:07:59,463 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:07:59,463 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:07:59,463 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:07:59,463 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. started... 2023-07-24 07:07:59,465 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 71c8e8aa5e202447273ccc302d81774d: 2023-07-24 07:07:59,465 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,465 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:07:59,466 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/5bcc8954c61e4597992bf16d2b2ff236.d963e5ae51d50c31e57c6fcbb9c21386->hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf/5bcc8954c61e4597992bf16d2b2ff236-top, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b.a7defafb03a7c1ae34fc645da6567483->hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b-top] hfiles 2023-07-24 07:07:59,466 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/5bcc8954c61e4597992bf16d2b2ff236.d963e5ae51d50c31e57c6fcbb9c21386 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,467 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 07:07:59,467 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 07:07:59,467 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:59,467 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b.a7defafb03a7c1ae34fc645da6567483 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,467 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:59,467 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 07:07:59,467 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 07:07:59,502 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. completed. 2023-07-24 07:07:59,502 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:07:59,503 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:07:59,503 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:07:59,503 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,503 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 07:07:59,503 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:07:59,510 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 07:07:59,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:59,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:59,510 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 07:07:59,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:59,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:07:59,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 07:07:59,515 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 07:07:59,515 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:07:59,515 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:07:59,515 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,515 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:59,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:59,518 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:07:59,519 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:59,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:59,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:59,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:07:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,520 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,520 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:07:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,531 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:07:59,532 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,532 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,536 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:59,536 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:59,536 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:59,537 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:07:59,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:59,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:07:59,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:59,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:59,536 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,536 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:59,536 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:59,537 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:07:59,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:59,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:59,537 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:07:59,537 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:07:59,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:59,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:07:59,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:59,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,537 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,538 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:07:59,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,649 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:59,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 07:07:59,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:07:59,652 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:07:59,750 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 07:07:59,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,753 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690182479326Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182479537 (+211 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182479538 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182479542 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690182479623 (+81 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690182479750 (+127 ms) 2023-07-24 07:07:59,757 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 07:07:59,760 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 426 msec 2023-07-24 07:07:59,952 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:07:59,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 07:07:59,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:07:59,954 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954 2023-07-24 07:07:59,955 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38471, tgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954, rawTgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:59,994 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:07:59,994 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1248435014_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:07:59,994 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 07:08:00,012 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:00,050 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,050 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,051 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,051 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,051 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,052 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,052 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,134 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-7876247629009216822.jar 2023-07-24 07:08:00,134 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,135 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,135 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,136 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,136 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,137 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:00,137 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:08:00,138 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:08:00,139 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:08:00,139 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:08:00,140 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:08:00,140 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:08:00,141 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:08:00,141 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:08:00,142 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:08:00,142 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:08:00,143 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:00,143 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:00,144 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:00,144 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:00,144 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:00,144 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:00,145 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:01,302 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:08:01,304 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 07:08:01,307 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 07:08:01,384 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:01,384 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:01,602 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:03,589 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:08:07,711 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:10,010 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:14,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:16,584 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:08:16,596 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:08:16,613 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,614 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:08:16,614 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:08:16,615 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,615 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 07:08:16,615 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 07:08:16,615 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 07:08:16,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182479954/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 07:08:16,626 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 07:08:16,635 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182496635"}]},"ts":"1690182496635"} 2023-07-24 07:08:16,637 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 07:08:16,639 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 07:08:16,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, UNASSIGN}] 2023-07-24 07:08:16,645 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, UNASSIGN 2023-07-24 07:08:16,648 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=71c8e8aa5e202447273ccc302d81774d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:16,648 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182496647"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182496647"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182496647"}]},"ts":"1690182496647"} 2023-07-24 07:08:16,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 71c8e8aa5e202447273ccc302d81774d, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:08:16,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 07:08:16,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:08:16,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 71c8e8aa5e202447273ccc302d81774d, disabling compactions & flushes 2023-07-24 07:08:16,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:08:16,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:08:16,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. after waiting 0 ms 2023-07-24 07:08:16,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:08:16,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 07:08:16,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:16,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d. 2023-07-24 07:08:16,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 71c8e8aa5e202447273ccc302d81774d: 2023-07-24 07:08:16,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:08:16,877 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=71c8e8aa5e202447273ccc302d81774d, regionState=CLOSED 2023-07-24 07:08:16,878 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690182496877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182496877"}]},"ts":"1690182496877"} 2023-07-24 07:08:16,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 07:08:16,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 71c8e8aa5e202447273ccc302d81774d, server=jenkins-hbase4.apache.org,43877,1690182392360 in 239 msec 2023-07-24 07:08:16,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 07:08:16,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=71c8e8aa5e202447273ccc302d81774d, UNASSIGN in 252 msec 2023-07-24 07:08:16,896 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182496896"}]},"ts":"1690182496896"} 2023-07-24 07:08:16,898 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 07:08:16,900 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 07:08:16,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 274 msec 2023-07-24 07:08:16,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 07:08:16,936 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 07:08:16,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,944 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,945 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,947 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,954 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,954 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,954 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,954 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:16,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:16,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:16,955 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:16,956 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:16,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:16,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:16,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:16,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:16,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 07:08:16,967 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:08:16,971 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/recovered.edits] 2023-07-24 07:08:16,975 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:08:16,975 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:08:16,981 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/recovered.edits] 2023-07-24 07:08:16,986 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/recovered.edits] 2023-07-24 07:08:17,000 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/5bcc8954c61e4597992bf16d2b2ff236.d963e5ae51d50c31e57c6fcbb9c21386 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/5bcc8954c61e4597992bf16d2b2ff236.d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:08:17,004 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b.a7defafb03a7c1ae34fc645da6567483 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b.a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:08:17,006 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/cf/cf13e89233ac4dbfb9cedb1f87f8ab4b 2023-07-24 07:08:17,012 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf/5bcc8954c61e4597992bf16d2b2ff236 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/cf/5bcc8954c61e4597992bf16d2b2ff236 2023-07-24 07:08:17,016 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/recovered.edits/8.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386/recovered.edits/8.seqid 2023-07-24 07:08:17,017 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d963e5ae51d50c31e57c6fcbb9c21386 2023-07-24 07:08:17,023 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/recovered.edits/8.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483/recovered.edits/8.seqid 2023-07-24 07:08:17,024 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a7defafb03a7c1ae34fc645da6567483 2023-07-24 07:08:17,025 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/recovered.edits/12.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d/recovered.edits/12.seqid 2023-07-24 07:08:17,026 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/71c8e8aa5e202447273ccc302d81774d 2023-07-24 07:08:17,026 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 07:08:17,029 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:17,051 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 07:08:17,057 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 07:08:17,059 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:17,059 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 07:08:17,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182497059"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:17,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 07:08:17,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 07:08:17,069 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 71c8e8aa5e202447273ccc302d81774d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690182476304.71c8e8aa5e202447273ccc302d81774d.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 07:08:17,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 07:08:17,069 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182497069"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:17,080 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 07:08:17,083 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:17,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 146 msec 2023-07-24 07:08:17,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 07:08:17,261 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 07:08:17,262 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 07:08:17,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182497269"}]},"ts":"1690182497269"} 2023-07-24 07:08:17,272 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 07:08:17,274 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 07:08:17,279 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, UNASSIGN}] 2023-07-24 07:08:17,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, UNASSIGN 2023-07-24 07:08:17,282 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, UNASSIGN 2023-07-24 07:08:17,283 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=cf91ef21a30091c23dee9e0aafc01a38, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:17,283 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182497283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182497283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182497283"}]},"ts":"1690182497283"} 2023-07-24 07:08:17,283 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=17aa90076555f47851c1da76b1a51800, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:17,283 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182497283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182497283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182497283"}]},"ts":"1690182497283"} 2023-07-24 07:08:17,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure cf91ef21a30091c23dee9e0aafc01a38, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:08:17,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 17aa90076555f47851c1da76b1a51800, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:08:17,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 07:08:17,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf91ef21a30091c23dee9e0aafc01a38, disabling compactions & flushes 2023-07-24 07:08:17,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. after waiting 0 ms 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:08:17,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 17aa90076555f47851c1da76b1a51800 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 17aa90076555f47851c1da76b1a51800, disabling compactions & flushes 2023-07-24 07:08:17,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. after waiting 0 ms 2023-07-24 07:08:17,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:08:17,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:17,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:17,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38. 2023-07-24 07:08:17,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf91ef21a30091c23dee9e0aafc01a38: 2023-07-24 07:08:17,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:17,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:08:17,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:17,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800. 2023-07-24 07:08:17,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 17aa90076555f47851c1da76b1a51800: 2023-07-24 07:08:17,501 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=cf91ef21a30091c23dee9e0aafc01a38, regionState=CLOSED 2023-07-24 07:08:17,501 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182497501"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182497501"}]},"ts":"1690182497501"} 2023-07-24 07:08:17,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 17aa90076555f47851c1da76b1a51800 2023-07-24 07:08:17,504 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=17aa90076555f47851c1da76b1a51800, regionState=CLOSED 2023-07-24 07:08:17,504 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690182497504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182497504"}]},"ts":"1690182497504"} 2023-07-24 07:08:17,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 07:08:17,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure cf91ef21a30091c23dee9e0aafc01a38, server=jenkins-hbase4.apache.org,43877,1690182392360 in 219 msec 2023-07-24 07:08:17,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 07:08:17,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 17aa90076555f47851c1da76b1a51800, server=jenkins-hbase4.apache.org,44417,1690182392314 in 220 msec 2023-07-24 07:08:17,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cf91ef21a30091c23dee9e0aafc01a38, UNASSIGN in 237 msec 2023-07-24 07:08:17,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-24 07:08:17,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=17aa90076555f47851c1da76b1a51800, UNASSIGN in 237 msec 2023-07-24 07:08:17,520 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182497520"}]},"ts":"1690182497520"} 2023-07-24 07:08:17,523 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 07:08:17,525 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 07:08:17,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 263 msec 2023-07-24 07:08:17,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 07:08:17,573 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 07:08:17,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,578 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,579 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,581 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,584 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,584 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,584 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,586 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:08:17,586 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 2023-07-24 07:08:17,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:17,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:17,588 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:17,589 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,589 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 07:08:17,591 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,591 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:17,591 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,591 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:17,591 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,591 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:17,592 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,592 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:17,592 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/recovered.edits] 2023-07-24 07:08:17,594 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/recovered.edits] 2023-07-24 07:08:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 07:08:17,602 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf/15419da24619453d864dba6647dcea5d to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/cf/15419da24619453d864dba6647dcea5d 2023-07-24 07:08:17,602 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf/f277db9d579245fdae0fb789027b38f6 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/cf/f277db9d579245fdae0fb789027b38f6 2023-07-24 07:08:17,606 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38/recovered.edits/9.seqid 2023-07-24 07:08:17,607 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800/recovered.edits/9.seqid 2023-07-24 07:08:17,608 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cf91ef21a30091c23dee9e0aafc01a38 2023-07-24 07:08:17,609 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/17aa90076555f47851c1da76b1a51800 2023-07-24 07:08:17,609 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 07:08:17,609 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 07:08:17,610 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 07:08:17,615 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724fbbdb3c35c5d4abdb0fbba8c318c6225 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724fbbdb3c35c5d4abdb0fbba8c318c6225 2023-07-24 07:08:17,617 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e3c47a8a55a54111819f8a2e89ecc682 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e3c47a8a55a54111819f8a2e89ecc682 2023-07-24 07:08:17,617 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 07:08:17,623 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,627 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 07:08:17,633 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 07:08:17,635 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,635 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 07:08:17,635 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182497635"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:17,635 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182497635"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:17,637 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:08:17,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cf91ef21a30091c23dee9e0aafc01a38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690182473184.cf91ef21a30091c23dee9e0aafc01a38.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 17aa90076555f47851c1da76b1a51800, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690182473184.17aa90076555f47851c1da76b1a51800.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:08:17,637 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 07:08:17,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182497637"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:17,639 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 07:08:17,643 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 69 msec 2023-07-24 07:08:17,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 07:08:17,696 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 07:08:17,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 07:08:17,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 07:08:17,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 07:08:17,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 07:08:17,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 07:08:17,779 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 745) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:44809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4096 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:39892 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:35052 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_359284763_1 at /127.0.0.1:33830 [Cleaning up] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:33860 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=448 (was 437) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=4917 (was 5840) 2023-07-24 07:08:17,779 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-24 07:08:17,812 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=448, ProcessCount=181, AvailableMemoryMB=4913 2023-07-24 07:08:17,812 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-24 07:08:17,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 07:08:17,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:17,821 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:08:17,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 07:08:17,822 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:08:17,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:17,826 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:17,826 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:17,827 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 empty. 2023-07-24 07:08:17,827 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a empty. 2023-07-24 07:08:17,828 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:17,828 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:17,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 07:08:17,904 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 07:08:17,907 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b33361086f44741ac7c0c97fb4069ef7, NAME => 'testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:08:17,915 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0c07eadfb28fe6cdcf51e860a4eefc2a, NAME => 'testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:08:17,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:18,011 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:18,011 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b33361086f44741ac7c0c97fb4069ef7, disabling compactions & flushes 2023-07-24 07:08:18,011 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,011 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,012 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. after waiting 1 ms 2023-07-24 07:08:18,012 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,012 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,012 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b33361086f44741ac7c0c97fb4069ef7: 2023-07-24 07:08:18,015 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:18,015 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0c07eadfb28fe6cdcf51e860a4eefc2a, disabling compactions & flushes 2023-07-24 07:08:18,015 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,015 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,015 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. after waiting 0 ms 2023-07-24 07:08:18,015 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,015 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,015 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0c07eadfb28fe6cdcf51e860a4eefc2a: 2023-07-24 07:08:18,018 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:08:18,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182498020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182498020"}]},"ts":"1690182498020"} 2023-07-24 07:08:18,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182498020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182498020"}]},"ts":"1690182498020"} 2023-07-24 07:08:18,023 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:08:18,024 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:08:18,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182498024"}]},"ts":"1690182498024"} 2023-07-24 07:08:18,026 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 07:08:18,124 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:08:18,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:18,128 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:08:18,128 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:08:18,128 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:08:18,128 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:08:18,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, ASSIGN}] 2023-07-24 07:08:18,138 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, ASSIGN 2023-07-24 07:08:18,139 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, ASSIGN 2023-07-24 07:08:18,141 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43877,1690182392360; forceNewPlan=false, retain=false 2023-07-24 07:08:18,141 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35087,1690182392228; forceNewPlan=false, retain=false 2023-07-24 07:08:18,292 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:08:18,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0c07eadfb28fe6cdcf51e860a4eefc2a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:18,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b33361086f44741ac7c0c97fb4069ef7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:18,296 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182498295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182498295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182498295"}]},"ts":"1690182498295"} 2023-07-24 07:08:18,296 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182498295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182498295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182498295"}]},"ts":"1690182498295"} 2023-07-24 07:08:18,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 0c07eadfb28fe6cdcf51e860a4eefc2a, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:08:18,299 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure b33361086f44741ac7c0c97fb4069ef7, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:08:18,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:18,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c07eadfb28fe6cdcf51e860a4eefc2a, NAME => 'testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:08:18,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. service=AccessControlService 2023-07-24 07:08:18,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:18,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:18,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,472 INFO [StoreOpener-0c07eadfb28fe6cdcf51e860a4eefc2a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b33361086f44741ac7c0c97fb4069ef7, NAME => 'testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:08:18,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. service=AccessControlService 2023-07-24 07:08:18,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:18,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:18,477 DEBUG [StoreOpener-0c07eadfb28fe6cdcf51e860a4eefc2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf 2023-07-24 07:08:18,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,478 DEBUG [StoreOpener-0c07eadfb28fe6cdcf51e860a4eefc2a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf 2023-07-24 07:08:18,479 INFO [StoreOpener-0c07eadfb28fe6cdcf51e860a4eefc2a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c07eadfb28fe6cdcf51e860a4eefc2a columnFamilyName cf 2023-07-24 07:08:18,481 INFO [StoreOpener-0c07eadfb28fe6cdcf51e860a4eefc2a-1] regionserver.HStore(310): Store=0c07eadfb28fe6cdcf51e860a4eefc2a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:18,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,493 INFO [StoreOpener-b33361086f44741ac7c0c97fb4069ef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,497 DEBUG [StoreOpener-b33361086f44741ac7c0c97fb4069ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf 2023-07-24 07:08:18,497 DEBUG [StoreOpener-b33361086f44741ac7c0c97fb4069ef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf 2023-07-24 07:08:18,498 INFO [StoreOpener-b33361086f44741ac7c0c97fb4069ef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b33361086f44741ac7c0c97fb4069ef7 columnFamilyName cf 2023-07-24 07:08:18,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:18,500 INFO [StoreOpener-b33361086f44741ac7c0c97fb4069ef7-1] regionserver.HStore(310): Store=b33361086f44741ac7c0c97fb4069ef7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:18,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:18,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c07eadfb28fe6cdcf51e860a4eefc2a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67878468, jitterRate=0.011467993259429932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:18,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c07eadfb28fe6cdcf51e860a4eefc2a: 2023-07-24 07:08:18,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a., pid=93, masterSystemTime=1690182498451 2023-07-24 07:08:18,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:18,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:18,514 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0c07eadfb28fe6cdcf51e860a4eefc2a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:18,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182498514"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182498514"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182498514"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182498514"}]},"ts":"1690182498514"} 2023-07-24 07:08:18,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:18,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b33361086f44741ac7c0c97fb4069ef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68261832, jitterRate=0.017180562019348145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:18,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b33361086f44741ac7c0c97fb4069ef7: 2023-07-24 07:08:18,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7., pid=94, masterSystemTime=1690182498451 2023-07-24 07:08:18,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 07:08:18,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 0c07eadfb28fe6cdcf51e860a4eefc2a, server=jenkins-hbase4.apache.org,43877,1690182392360 in 218 msec 2023-07-24 07:08:18,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,519 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b33361086f44741ac7c0c97fb4069ef7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:18,520 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182498519"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182498519"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182498519"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182498519"}]},"ts":"1690182498519"} 2023-07-24 07:08:18,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, ASSIGN in 391 msec 2023-07-24 07:08:18,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 07:08:18,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure b33361086f44741ac7c0c97fb4069ef7, server=jenkins-hbase4.apache.org,35087,1690182392228 in 222 msec 2023-07-24 07:08:18,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-24 07:08:18,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, ASSIGN in 396 msec 2023-07-24 07:08:18,529 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:08:18,529 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182498529"}]},"ts":"1690182498529"} 2023-07-24 07:08:18,531 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 07:08:18,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:08:18,539 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 07:08:18,543 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:08:18,548 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:18,548 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:18,548 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:18,548 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:18,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:18,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:18,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:18,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:18,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 734 msec 2023-07-24 07:08:18,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 07:08:18,929 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 07:08:18,938 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:18,938 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:18,940 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:18,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182498959 (current time:1690182498959). 2023-07-24 07:08:18,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:18,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x7b81023e to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:18,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235657cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:18,986 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:18,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b81023e to 127.0.0.1:60170 2023-07-24 07:08:18,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:18,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc88fef to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:19,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cabeeda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:19,094 DEBUG [hconnection-0x7d5224bd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:19,098 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:19,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:19,107 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:19,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc88fef to 127.0.0.1:60170 2023-07-24 07:08:19,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:19,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:08:19,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:19,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:19,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:19,114 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:19,119 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183099119 2023-07-24 07:08:19,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:19,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:19,120 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:19,120 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:19,122 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:19,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:19,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 07:08:19,127 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:19,128 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183099128 2023-07-24 07:08:19,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,142 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 07:08:19,142 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:19,144 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 07:08:19,144 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:08:19,145 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,146 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,150 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:19,150 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:19,150 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:19,150 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:19,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:19,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:19,151 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,151 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:19,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:19,151 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,151 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 07:08:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:19,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,153 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:19,153 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:19,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 07:08:19,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:19,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,156 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:19,156 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 07:08:19,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,157 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:19,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,158 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,159 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:19,171 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:19,171 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:19,171 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:19,172 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:19,172 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:19,172 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:19,174 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,174 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:19,175 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,175 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,175 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:19,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:19,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40331d37[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:19,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:19,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:19,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,183 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,183 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:19,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:19,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:19,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40331d37[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:19,184 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:08:19,184 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:19,186 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,186 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:19,186 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:19,186 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:08:19,187 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,187 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,187 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:19,187 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:19,188 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:19,188 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,188 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:19,188 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:19,188 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. started... 2023-07-24 07:08:19,194 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:19,189 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:19,195 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:19,195 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b33361086f44741ac7c0c97fb4069ef7: 2023-07-24 07:08:19,188 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:19,195 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. started... 2023-07-24 07:08:19,195 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,195 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:19,195 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:19,197 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c07eadfb28fe6cdcf51e860a4eefc2a: 2023-07-24 07:08:19,197 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:19,197 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:19,197 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,197 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:19,197 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:19,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:19,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:19,222 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:19,287 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. completed. 2023-07-24 07:08:19,287 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:19,287 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:08:19,290 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:19,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:19,290 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:19,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35087,1690182392228': 2023-07-24 07:08:19,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:08:19,422 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:19,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:19,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:19,425 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:08:19,658 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. completed. 2023-07-24 07:08:19,658 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:19,658 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:19,658 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:19,658 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,658 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:19,658 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:08:19,661 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:19,661 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:19,661 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:19,662 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:19,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:08:19,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:08:19,682 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 07:08:19,682 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:19,682 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:19,682 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,682 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:19,685 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:19,685 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:19,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:19,685 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:19,685 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,687 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:19,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:19,688 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:19,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:19,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:19,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:19,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,689 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,690 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,693 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:19,694 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,694 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:19,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:19,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:19,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:19,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:19,700 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:19,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:19,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:19,700 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,701 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:19,701 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:19,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:19,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:19,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:08:19,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:19,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:19,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:19,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:19,701 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:19,702 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:19,702 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,702 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 07:08:19,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,725 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:19,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:19,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:19,726 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 07:08:19,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,789 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 07:08:19,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,790 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:19,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690182499119Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690182499720 (+601 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690182499720Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690182499720Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690182499728 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690182499748 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690182499789 (+41 ms) 2023-07-24 07:08:19,794 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:19,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 674 msec 2023-07-24 07:08:20,226 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:20,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:20,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:20,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35087] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:20,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43877] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:20,235 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:20,235 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:20,235 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:20,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:20,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182500247 (current time:1690182500247). 2023-07-24 07:08:20,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:20,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x250696be to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:20,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@491d396f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:20,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:20,263 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:20,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x250696be to 127.0.0.1:60170 2023-07-24 07:08:20,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:20,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x70859c4d to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:20,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61a75785, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:20,273 DEBUG [hconnection-0x4151cc9f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:20,274 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:20,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:20,279 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70859c4d to 127.0.0.1:60170 2023-07-24 07:08:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 07:08:20,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:20,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:20,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:20,284 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:20,284 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690183100284 2023-07-24 07:08:20,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:20,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 07:08:20,286 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:20,286 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:20,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:20,287 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 07:08:20,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 07:08:20,313 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:20,314 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690183100314 2023-07-24 07:08:20,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,343 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 07:08:20,343 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:20,345 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 07:08:20,345 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 07:08:20,346 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,346 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,347 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:20,347 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:20,347 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:20,348 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:20,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:20,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:20,348 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,348 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,349 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,349 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:20,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:20,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 07:08:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 07:08:20,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,352 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 07:08:20,352 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:20,352 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,353 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:20,353 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:20,352 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:20,353 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:20,355 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,358 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:20,359 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 07:08:20,358 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,358 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,359 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:20,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:20,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:20,359 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 07:08:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 07:08:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 07:08:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,364 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:20,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,366 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,366 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,367 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:20,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@266f764b[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:20,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:20,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 07:08:20,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@266f764b[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:20,374 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 07:08:20,374 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,379 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,379 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:08:20,380 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,380 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:20,380 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:20,380 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,380 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:20,380 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:20,381 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:20,381 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:20,380 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. started... 2023-07-24 07:08:20,381 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. started... 2023-07-24 07:08:20,381 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:20,381 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b33361086f44741ac7c0c97fb4069ef7 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 07:08:20,381 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0c07eadfb28fe6cdcf51e860a4eefc2a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 07:08:20,382 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:20,382 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:20,382 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:20,386 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:20,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:20,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:20,390 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:20,474 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724ffd1d9009b5d4827a3902887aa7ec5d4 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffd1d9009b5d4827a3902887aa7ec5d4 2023-07-24 07:08:20,477 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724217336a7f9cb47908675370b43c0e2ec to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724217336a7f9cb47908675370b43c0e2ec 2023-07-24 07:08:20,511 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/.tmp/cf/e8490cc709694661a2920febcfbb4ad5 2023-07-24 07:08:20,515 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/.tmp/cf/b563faa2190f4021b155b9dc9ee89b67 2023-07-24 07:08:20,519 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/.tmp/cf/e8490cc709694661a2920febcfbb4ad5 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf/e8490cc709694661a2920febcfbb4ad5 2023-07-24 07:08:20,521 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/.tmp/cf/b563faa2190f4021b155b9dc9ee89b67 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf/b563faa2190f4021b155b9dc9ee89b67 2023-07-24 07:08:20,525 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf/e8490cc709694661a2920febcfbb4ad5, entries=47, sequenceid=6, filesize=13.1 K 2023-07-24 07:08:20,527 INFO [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0c07eadfb28fe6cdcf51e860a4eefc2a in 146ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:20,528 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 07:08:20,528 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c07eadfb28fe6cdcf51e860a4eefc2a: 2023-07-24 07:08:20,528 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,528 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:20,529 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf/b563faa2190f4021b155b9dc9ee89b67, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 07:08:20,529 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf/e8490cc709694661a2920febcfbb4ad5] hfiles 2023-07-24 07:08:20,529 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf/e8490cc709694661a2920febcfbb4ad5 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,535 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b33361086f44741ac7c0c97fb4069ef7 in 154ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:20,538 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b33361086f44741ac7c0c97fb4069ef7: 2023-07-24 07:08:20,538 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,540 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:20,540 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf/b563faa2190f4021b155b9dc9ee89b67] hfiles 2023-07-24 07:08:20,540 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf/b563faa2190f4021b155b9dc9ee89b67 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,579 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. completed. 2023-07-24 07:08:20,579 DEBUG [rs(jenkins-hbase4.apache.org,43877,1690182392360)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:20,579 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:08:20,586 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:20,586 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,586 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:20,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:20,586 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:20,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,590 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:20,590 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. completed. 2023-07-24 07:08:20,590 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 07:08:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:08:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:20,591 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:08:20,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,593 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,593 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 07:08:20,593 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:20,593 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 07:08:20,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:20,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43877,1690182392360': 2023-07-24 07:08:20,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 07:08:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:20,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35087,1690182392228': 2023-07-24 07:08:20,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 07:08:20,601 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 07:08:20,601 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:20,601 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:20,601 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,601 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:20,603 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,603 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:20,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,603 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:20,604 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:20,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:20,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:20,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:20,605 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,605 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,606 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,611 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,611 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,612 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:20,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:20,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:20,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:20,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:20,616 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:20,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:20,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:20,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:20,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:20,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:20,616 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:20,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:20,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,618 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:08:20,619 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:20,619 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,619 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:20,619 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:20,619 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,619 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724217336a7f9cb47908675370b43c0e2ec, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffd1d9009b5d4827a3902887aa7ec5d4] mob files 2023-07-24 07:08:20,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724217336a7f9cb47908675370b43c0e2ec 2023-07-24 07:08:20,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffd1d9009b5d4827a3902887aa7ec5d4 2023-07-24 07:08:20,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,745 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0005_000001 (auth:SIMPLE) 2023-07-24 07:08:20,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 07:08:20,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,784 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690182500285Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690182500672 (+387 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690182500672Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690182500672Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690182500701 (+29 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690182500744 (+43 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690182500783 (+39 ms) 2023-07-24 07:08:20,790 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 07:08:20,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 505 msec 2023-07-24 07:08:20,891 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:20,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 07:08:20,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:20,893 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893 2023-07-24 07:08:20,893 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38471, tgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893, rawTgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:08:20,918 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:08:20,918 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1275271265_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:20,918 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 07:08:20,924 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:21,002 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,002 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,003 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,003 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,003 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,004 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,092 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-6218400706960301404.jar 2023-07-24 07:08:21,092 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,093 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,093 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,093 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,094 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,094 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:21,094 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:08:21,095 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:08:21,095 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:08:21,095 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:08:21,096 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:08:21,096 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:08:21,097 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:08:21,097 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:08:21,097 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:08:21,098 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:08:21,099 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:21,099 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:21,100 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:21,100 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:21,100 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:21,101 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:21,102 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:22,229 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:08:22,233 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 07:08:22,437 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:22,437 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:22,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0006_000001 (auth:SIMPLE) 2023-07-24 07:08:22,591 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:08:28,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0006_000001 (auth:SIMPLE) 2023-07-24 07:08:30,563 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:08:30,564 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:08:30,583 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:30,583 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:08:30,583 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:08:30,584 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:30,584 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 07:08:30,584 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 07:08:30,584 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:30,585 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 07:08:30,585 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182500893/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 07:08:30,601 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 07:08:30,608 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182510608"}]},"ts":"1690182510608"} 2023-07-24 07:08:30,611 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 07:08:30,614 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 07:08:30,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, UNASSIGN}] 2023-07-24 07:08:30,616 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, UNASSIGN 2023-07-24 07:08:30,618 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, UNASSIGN 2023-07-24 07:08:30,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0c07eadfb28fe6cdcf51e860a4eefc2a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:30,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182510619"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182510619"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182510619"}]},"ts":"1690182510619"} 2023-07-24 07:08:30,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b33361086f44741ac7c0c97fb4069ef7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:30,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182510620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182510620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182510620"}]},"ts":"1690182510620"} 2023-07-24 07:08:30,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 0c07eadfb28fe6cdcf51e860a4eefc2a, server=jenkins-hbase4.apache.org,43877,1690182392360}] 2023-07-24 07:08:30,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure b33361086f44741ac7c0c97fb4069ef7, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:08:30,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 07:08:30,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:30,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c07eadfb28fe6cdcf51e860a4eefc2a, disabling compactions & flushes 2023-07-24 07:08:30,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:30,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:30,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. after waiting 0 ms 2023-07-24 07:08:30,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:30,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:30,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b33361086f44741ac7c0c97fb4069ef7, disabling compactions & flushes 2023-07-24 07:08:30,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:30,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:30,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. after waiting 0 ms 2023-07-24 07:08:30,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:30,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:30,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:30,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:30,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:30,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a. 2023-07-24 07:08:30,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c07eadfb28fe6cdcf51e860a4eefc2a: 2023-07-24 07:08:30,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7. 2023-07-24 07:08:30,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b33361086f44741ac7c0c97fb4069ef7: 2023-07-24 07:08:30,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:30,867 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0c07eadfb28fe6cdcf51e860a4eefc2a, regionState=CLOSED 2023-07-24 07:08:30,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182510867"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182510867"}]},"ts":"1690182510867"} 2023-07-24 07:08:30,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:30,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b33361086f44741ac7c0c97fb4069ef7, regionState=CLOSED 2023-07-24 07:08:30,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690182510870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182510870"}]},"ts":"1690182510870"} 2023-07-24 07:08:30,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-24 07:08:30,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 0c07eadfb28fe6cdcf51e860a4eefc2a, server=jenkins-hbase4.apache.org,43877,1690182392360 in 248 msec 2023-07-24 07:08:30,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-24 07:08:30,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure b33361086f44741ac7c0c97fb4069ef7, server=jenkins-hbase4.apache.org,35087,1690182392228 in 249 msec 2023-07-24 07:08:30,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0c07eadfb28fe6cdcf51e860a4eefc2a, UNASSIGN in 261 msec 2023-07-24 07:08:30,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 07:08:30,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b33361086f44741ac7c0c97fb4069ef7, UNASSIGN in 262 msec 2023-07-24 07:08:30,882 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182510882"}]},"ts":"1690182510882"} 2023-07-24 07:08:30,885 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 07:08:30,892 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 07:08:30,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 291 msec 2023-07-24 07:08:30,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 07:08:30,916 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 07:08:30,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,922 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,923 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,927 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,930 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,930 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,930 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,931 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 07:08:30,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 07:08:30,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 07:08:30,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 07:08:30,933 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:30,933 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:30,933 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:30,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:30,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:30,934 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,935 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:30,936 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/recovered.edits] 2023-07-24 07:08:30,936 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/recovered.edits] 2023-07-24 07:08:30,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 07:08:30,946 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf/e8490cc709694661a2920febcfbb4ad5 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/cf/e8490cc709694661a2920febcfbb4ad5 2023-07-24 07:08:30,949 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf/b563faa2190f4021b155b9dc9ee89b67 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/cf/b563faa2190f4021b155b9dc9ee89b67 2023-07-24 07:08:30,952 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a/recovered.edits/9.seqid 2023-07-24 07:08:30,952 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/0c07eadfb28fe6cdcf51e860a4eefc2a 2023-07-24 07:08:30,954 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7/recovered.edits/9.seqid 2023-07-24 07:08:30,955 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testEmptyExportFileSystemState/b33361086f44741ac7c0c97fb4069ef7 2023-07-24 07:08:30,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 07:08:30,955 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 07:08:30,956 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 07:08:30,960 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724217336a7f9cb47908675370b43c0e2ec to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724217336a7f9cb47908675370b43c0e2ec 2023-07-24 07:08:30,961 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffd1d9009b5d4827a3902887aa7ec5d4 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724ffd1d9009b5d4827a3902887aa7ec5d4 2023-07-24 07:08:30,962 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 07:08:30,967 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,979 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 07:08:30,994 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 07:08:30,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:30,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 07:08:30,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182510996"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:30,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182510996"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:31,011 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:08:31,011 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b33361086f44741ac7c0c97fb4069ef7, NAME => 'testtb-testEmptyExportFileSystemState,,1690182497815.b33361086f44741ac7c0c97fb4069ef7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0c07eadfb28fe6cdcf51e860a4eefc2a, NAME => 'testtb-testEmptyExportFileSystemState,1,1690182497815.0c07eadfb28fe6cdcf51e860a4eefc2a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:08:31,011 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 07:08:31,011 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182511011"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:31,022 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 07:08:31,027 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 07:08:31,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 111 msec 2023-07-24 07:08:31,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 07:08:31,045 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 07:08:31,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 07:08:31,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:31,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 07:08:31,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 07:08:31,118 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:50294 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:37952 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:35333 from appattempt_1690182401381_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:42551 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1121377866_1 at /127.0.0.1:41644 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4901 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:35374 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1121377866_1 at /127.0.0.1:33422 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=480 (was 448) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=5069 (was 4913) - AvailableMemoryMB LEAK? - 2023-07-24 07:08:31,118 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 07:08:31,155 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=480, ProcessCount=181, AvailableMemoryMB=5061 2023-07-24 07:08:31,155 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 07:08:31,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 07:08:31,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:31,163 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 07:08:31,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 07:08:31,164 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 07:08:31,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:31,171 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,171 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,172 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 empty. 2023-07-24 07:08:31,172 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead empty. 2023-07-24 07:08:31,173 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,173 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,173 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 07:08:31,262 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 07:08:31,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:31,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ce18d1808671221f701bbc8d93940f1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:08:31,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a3e53128463099081b265102a53eead, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp 2023-07-24 07:08:31,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:31,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 7ce18d1808671221f701bbc8d93940f1, disabling compactions & flushes 2023-07-24 07:08:31,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. after waiting 0 ms 2023-07-24 07:08:31,338 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,339 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,339 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 7ce18d1808671221f701bbc8d93940f1: 2023-07-24 07:08:31,369 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:31,369 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 8a3e53128463099081b265102a53eead, disabling compactions & flushes 2023-07-24 07:08:31,369 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,369 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,369 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. after waiting 0 ms 2023-07-24 07:08:31,369 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,369 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,369 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 8a3e53128463099081b265102a53eead: 2023-07-24 07:08:31,374 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 07:08:31,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182511375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182511375"}]},"ts":"1690182511375"} 2023-07-24 07:08:31,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182511375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182511375"}]},"ts":"1690182511375"} 2023-07-24 07:08:31,382 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 07:08:31,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 07:08:31,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182511383"}]},"ts":"1690182511383"} 2023-07-24 07:08:31,386 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 07:08:31,391 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 07:08:31,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 07:08:31,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 07:08:31,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 07:08:31,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 07:08:31,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, ASSIGN}] 2023-07-24 07:08:31,397 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, ASSIGN 2023-07-24 07:08:31,397 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, ASSIGN 2023-07-24 07:08:31,399 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35087,1690182392228; forceNewPlan=false, retain=false 2023-07-24 07:08:31,400 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44417,1690182392314; forceNewPlan=false, retain=false 2023-07-24 07:08:31,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:31,549 INFO [jenkins-hbase4:34101] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 07:08:31,553 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8a3e53128463099081b265102a53eead, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:31,553 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7ce18d1808671221f701bbc8d93940f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:31,553 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182511553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182511553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182511553"}]},"ts":"1690182511553"} 2023-07-24 07:08:31,553 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182511553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182511553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182511553"}]},"ts":"1690182511553"} 2023-07-24 07:08:31,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 8a3e53128463099081b265102a53eead, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:08:31,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 7ce18d1808671221f701bbc8d93940f1, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:08:31,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a3e53128463099081b265102a53eead, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 07:08:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. service=AccessControlService 2023-07-24 07:08:31,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,724 INFO [StoreOpener-8a3e53128463099081b265102a53eead-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ce18d1808671221f701bbc8d93940f1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 07:08:31,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. service=AccessControlService 2023-07-24 07:08:31,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 07:08:31,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 07:08:31,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,733 DEBUG [StoreOpener-8a3e53128463099081b265102a53eead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf 2023-07-24 07:08:31,733 DEBUG [StoreOpener-8a3e53128463099081b265102a53eead-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf 2023-07-24 07:08:31,733 INFO [StoreOpener-8a3e53128463099081b265102a53eead-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a3e53128463099081b265102a53eead columnFamilyName cf 2023-07-24 07:08:31,737 INFO [StoreOpener-8a3e53128463099081b265102a53eead-1] regionserver.HStore(310): Store=8a3e53128463099081b265102a53eead/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:31,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a3e53128463099081b265102a53eead 2023-07-24 07:08:31,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:31,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a3e53128463099081b265102a53eead; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62680006, jitterRate=-0.06599512696266174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:31,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a3e53128463099081b265102a53eead: 2023-07-24 07:08:31,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead., pid=108, masterSystemTime=1690182511706 2023-07-24 07:08:31,747 INFO [StoreOpener-7ce18d1808671221f701bbc8d93940f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:31,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8a3e53128463099081b265102a53eead, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:31,749 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182511748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182511748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182511748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182511748"}]},"ts":"1690182511748"} 2023-07-24 07:08:31,749 DEBUG [StoreOpener-7ce18d1808671221f701bbc8d93940f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf 2023-07-24 07:08:31,749 DEBUG [StoreOpener-7ce18d1808671221f701bbc8d93940f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf 2023-07-24 07:08:31,750 INFO [StoreOpener-7ce18d1808671221f701bbc8d93940f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ce18d1808671221f701bbc8d93940f1 columnFamilyName cf 2023-07-24 07:08:31,751 INFO [StoreOpener-7ce18d1808671221f701bbc8d93940f1-1] regionserver.HStore(310): Store=7ce18d1808671221f701bbc8d93940f1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 07:08:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 07:08:31,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 8a3e53128463099081b265102a53eead, server=jenkins-hbase4.apache.org,35087,1690182392228 in 196 msec 2023-07-24 07:08:31,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:31,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, ASSIGN in 366 msec 2023-07-24 07:08:31,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 07:08:31,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ce18d1808671221f701bbc8d93940f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69537019, jitterRate=0.036182329058647156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 07:08:31,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ce18d1808671221f701bbc8d93940f1: 2023-07-24 07:08:31,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1., pid=109, masterSystemTime=1690182511708 2023-07-24 07:08:31,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:31,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7ce18d1808671221f701bbc8d93940f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:31,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182511773"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690182511773"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690182511773"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690182511773"}]},"ts":"1690182511773"} 2023-07-24 07:08:31,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 07:08:31,785 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 7ce18d1808671221f701bbc8d93940f1, server=jenkins-hbase4.apache.org,44417,1690182392314 in 221 msec 2023-07-24 07:08:31,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 07:08:31,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, ASSIGN in 392 msec 2023-07-24 07:08:31,788 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 07:08:31,788 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182511788"}]},"ts":"1690182511788"} 2023-07-24 07:08:31,790 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 07:08:31,793 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 07:08:31,793 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 07:08:31,795 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 07:08:31,799 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:31,800 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:31,800 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:31,800 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:31,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:31,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:31,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:31,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 07:08:31,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 645 msec 2023-07-24 07:08:32,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 07:08:32,272 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 07:08:32,277 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,278 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:32,280 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:32,349 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182512349 (current time:1690182512349). 2023-07-24 07:08:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:32,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x01032d57 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:32,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30b5ad2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:32,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:32,420 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01032d57 to 127.0.0.1:60170 2023-07-24 07:08:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:32,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbc3f80 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:32,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54dd0f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:32,447 DEBUG [hconnection-0x180cd9a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:32,452 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:32,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:32,463 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:32,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbc3f80 to 127.0.0.1:60170 2023-07-24 07:08:32,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:32,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 07:08:32,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:32,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:32,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:32,471 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:32,475 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690183112475 2023-07-24 07:08:32,475 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:32,475 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:32,477 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:32,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:32,480 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:32,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-24 07:08:32,483 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:32,485 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690183112485 2023-07-24 07:08:32,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,499 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 07:08:32,499 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,501 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 07:08:32,501 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 07:08:32,505 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,505 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,507 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,507 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,507 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,508 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,508 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,509 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,509 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:32,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:32,510 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:32,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,511 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:32,511 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,513 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,514 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:32,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 07:08:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:32,524 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:32,526 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,527 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,527 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,527 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:32,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae6231b[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:32,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,535 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:32,535 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:32,539 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:32,542 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,542 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,542 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,542 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:32,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae6231b[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:32,554 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 07:08:32,554 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:32,556 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:32,556 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:08:32,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,556 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:32,556 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:32,557 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,557 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,557 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:32,559 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:32,559 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:32,559 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:32,563 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:32,563 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:32,578 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:32,579 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:32,579 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:32,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:32,579 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:32,580 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:32,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:32,584 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. started... 2023-07-24 07:08:32,584 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. started... 2023-07-24 07:08:32,589 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:32,589 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ce18d1808671221f701bbc8d93940f1: 2023-07-24 07:08:32,589 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a3e53128463099081b265102a53eead: 2023-07-24 07:08:32,589 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,589 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,589 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:32,589 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:32,590 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:32,590 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 07:08:32,620 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. completed. 2023-07-24 07:08:32,621 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:32,621 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:08:32,625 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:32,625 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,625 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,625 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:32,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,631 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. completed. 2023-07-24 07:08:32,631 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:32,631 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:32,631 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:32,631 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,631 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:32,631 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:08:32,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35087,1690182392228': 2023-07-24 07:08:32,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 07:08:32,633 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,633 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:32,634 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:32,634 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:08:32,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 07:08:32,638 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 07:08:32,638 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:32,638 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:32,638 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,638 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:32,640 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,640 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,640 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:32,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,640 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,641 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,640 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:32,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,641 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:32,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:32,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:32,642 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,643 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,643 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,645 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,646 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,646 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,654 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,654 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,654 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,656 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,657 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:32,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,657 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,656 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,657 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:32,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,657 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,657 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:32,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,657 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:32,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:08:32,657 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:32,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:32,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:32,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:32,659 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,660 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,660 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,660 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,660 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,660 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:32,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:32,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 07:08:32,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 07:08:32,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,726 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690182512475Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690182512669 (+194 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182512669Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182512669Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182512673 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690182512699 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690182512725 (+26 ms) 2023-07-24 07:08:32,728 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:32,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 251 msec 2023-07-24 07:08:32,789 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:32,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:32,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:32,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:32,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35087] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 07:08:32,799 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,799 DEBUG [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:32,800 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 07:08:32,813 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690182512813 (current time:1690182512813). 2023-07-24 07:08:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 07:08:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x065b9873 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:32,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7864a0f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:32,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:32,837 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:32,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x065b9873 to 127.0.0.1:60170 2023-07-24 07:08:32,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:32,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(139): Connect 0x67abb153 to 127.0.0.1:60170 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 07:08:32,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d6935d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 07:08:32,879 DEBUG [hconnection-0x60575997-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:32,883 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:32,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 07:08:32,892 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 07:08:32,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67abb153 to 127.0.0.1:60170 2023-07-24 07:08:32,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:08:32,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 07:08:32,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 07:08:32,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:32,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:32,898 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:32,899 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690183112899 2023-07-24 07:08:32,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 07:08:32,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,902 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 07:08:32,902 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 07:08:32,902 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 07:08:32,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:32,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 07:08:32,904 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:32,905 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690183112905 2023-07-24 07:08:32,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,916 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 07:08:32,916 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,918 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 07:08:32,918 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 07:08:32,919 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,919 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,920 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,920 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,920 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:32,920 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:32,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:32,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 07:08:32,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:32,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 07:08:32,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,922 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:32,922 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,923 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:32,924 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,924 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:32,924 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,924 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:32,925 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,924 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:32,926 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43877,1690182392360' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:32,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,926 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,926 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 07:08:32,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 07:08:32,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 07:08:32,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 07:08:32,927 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 07:08:32,928 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 07:08:32,928 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 07:08:32,928 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 07:08:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,929 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,929 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,930 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,930 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,931 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,931 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 07:08:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35087,1690182392228' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cc560b4[Count = 1] remaining members to acquire global barrier 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:32,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:32,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:32,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:32,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:32,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:32,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44417,1690182392314' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 07:08:32,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cc560b4[Count = 0] remaining members to acquire global barrier 2023-07-24 07:08:32,935 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 07:08:32,935 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:32,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:32,944 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:32,944 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:32,943 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 07:08:32,944 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:32,944 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43877,1690182392360' in zk 2023-07-24 07:08:32,944 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:32,944 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 07:08:32,945 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:32,945 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:32,945 DEBUG [member: 'jenkins-hbase4.apache.org,43877,1690182392360' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:32,953 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:32,953 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:32,955 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:32,955 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:32,955 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 07:08:32,955 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. started... 2023-07-24 07:08:32,955 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 07:08:32,955 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. started... 2023-07-24 07:08:32,955 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ce18d1808671221f701bbc8d93940f1 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 07:08:32,955 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a3e53128463099081b265102a53eead 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 07:08:33,002 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072462cc78a0ae8d4c31bfbea55bc26c1954 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072462cc78a0ae8d4c31bfbea55bc26c1954 2023-07-24 07:08:33,002 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:33,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:33,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:33,004 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 07:08:33,012 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724645ce2aed34843ae9182bb8028900ff6 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724645ce2aed34843ae9182bb8028900ff6 2023-07-24 07:08:33,015 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/.tmp/cf/80009836096b47d2b1f3162f1b4b7dfe 2023-07-24 07:08:33,021 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/.tmp/cf/80009836096b47d2b1f3162f1b4b7dfe as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf/80009836096b47d2b1f3162f1b4b7dfe 2023-07-24 07:08:33,029 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf/80009836096b47d2b1f3162f1b4b7dfe, entries=47, sequenceid=6, filesize=13.3 K 2023-07-24 07:08:33,035 INFO [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8a3e53128463099081b265102a53eead in 79ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:33,035 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 07:08:33,036 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a3e53128463099081b265102a53eead: 2023-07-24 07:08:33,036 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,036 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:33,036 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf/80009836096b47d2b1f3162f1b4b7dfe] hfiles 2023-07-24 07:08:33,036 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf/80009836096b47d2b1f3162f1b4b7dfe for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,039 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/.tmp/cf/98eb3993ed8c40fa9645263eb79fb35b 2023-07-24 07:08:33,047 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/.tmp/cf/98eb3993ed8c40fa9645263eb79fb35b as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf/98eb3993ed8c40fa9645263eb79fb35b 2023-07-24 07:08:33,052 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf/98eb3993ed8c40fa9645263eb79fb35b, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 07:08:33,053 INFO [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7ce18d1808671221f701bbc8d93940f1 in 98ms, sequenceid=6, compaction requested=false 2023-07-24 07:08:33,060 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ce18d1808671221f701bbc8d93940f1: 2023-07-24 07:08:33,061 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,061 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 07:08:33,061 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf/98eb3993ed8c40fa9645263eb79fb35b] hfiles 2023-07-24 07:08:33,061 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf/98eb3993ed8c40fa9645263eb79fb35b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,079 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. completed. 2023-07-24 07:08:33,079 DEBUG [rs(jenkins-hbase4.apache.org,35087,1690182392228)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:33,079 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:33,079 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:33,079 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,079 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:33,079 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35087,1690182392228' in zk 2023-07-24 07:08:33,081 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:33,081 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,081 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:33,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:33,081 DEBUG [member: 'jenkins-hbase4.apache.org,35087,1690182392228' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:33,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:33,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:33,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35087,1690182392228': 2023-07-24 07:08:33,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35087,1690182392228' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 07:08:33,098 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. completed. 2023-07-24 07:08:33,098 DEBUG [rs(jenkins-hbase4.apache.org,44417,1690182392314)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 07:08:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 07:08:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,098 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 07:08:33,099 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44417,1690182392314' in zk 2023-07-24 07:08:33,100 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 07:08:33,100 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:33,100 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,100 DEBUG [member: 'jenkins-hbase4.apache.org,44417,1690182392314' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 07:08:33,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:33,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44417,1690182392314': 2023-07-24 07:08:33,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44417,1690182392314' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 07:08:33,108 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 07:08:33,108 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 07:08:33,108 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 07:08:33,108 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,108 INFO [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 07:08:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:33,111 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:33,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:33,112 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 07:08:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,113 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,113 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 07:08:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,115 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 07:08:33,115 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,116 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:33,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,119 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 07:08:33,120 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:08:33,120 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:33,120 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,120 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:33,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:33,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 07:08:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 07:08:33,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,120 DEBUG [(jenkins-hbase4.apache.org,34101,1690182390803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 07:08:33,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 07:08:33,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072462cc78a0ae8d4c31bfbea55bc26c1954, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724645ce2aed34843ae9182bb8028900ff6] mob files 2023-07-24 07:08:33,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072462cc78a0ae8d4c31bfbea55bc26c1954 2023-07-24 07:08:33,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724645ce2aed34843ae9182bb8028900ff6 2023-07-24 07:08:33,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,204 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:33,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:33,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 07:08:33,206 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 07:08:33,223 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 07:08:33,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,223 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690182512899Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690182513141 (+242 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690182513141Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690182513141Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690182513151 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690182513175 (+24 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690182513223 (+48 ms) 2023-07-24 07:08:33,227 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 07:08:33,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 327 msec 2023-07-24 07:08:33,506 DEBUG [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 07:08:33,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 07:08:33,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 07:08:33,507 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507 2023-07-24 07:08:33,508 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:38471, tgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507, rawTgtDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507, srcFsUri=hdfs://localhost:38471, srcDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:08:33,543 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93 2023-07-24 07:08:33,543 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2010815089_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,543 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:38471, inputRoot=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93, snapshotDir=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 07:08:33,562 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:33,615 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,616 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,617 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,618 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,705 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/hadoop-2321562076654988435.jar 2023-07-24 07:08:33,705 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,706 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,706 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,707 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,707 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,707 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 07:08:33,708 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 07:08:33,708 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 07:08:33,709 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 07:08:33,709 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 07:08:33,710 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 07:08:33,711 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 07:08:33,711 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 07:08:33,711 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 07:08:33,712 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 07:08:33,713 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 07:08:33,713 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:33,714 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:33,714 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:33,715 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:33,715 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 07:08:33,716 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:33,716 DEBUG [Listener at jenkins-hbase4.apache.org/46799] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 07:08:34,820 WARN [Listener at jenkins-hbase4.apache.org/46799] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 07:08:34,822 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 07:08:34,825 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 07:08:35,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:35,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 07:08:35,693 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0006_000001 (auth:SIMPLE) 2023-07-24 07:08:35,744 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:36,485 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:08:41,474 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:43,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:48,099 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:50,076 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 07:08:50,076 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 07:08:50,089 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,089 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 07:08:50,090 INFO [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 07:08:50,090 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,090 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 07:08:50,090 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 07:08:50,090 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1778551598_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,091 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 07:08:50,091 DEBUG [Listener at jenkins-hbase4.apache.org/46799] snapshot.TestExportSnapshot(367): hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/export-test/export-1690182513507/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 07:08:50,099 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 07:08:50,104 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182530104"}]},"ts":"1690182530104"} 2023-07-24 07:08:50,105 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 07:08:50,107 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 07:08:50,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, UNASSIGN}] 2023-07-24 07:08:50,111 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, UNASSIGN 2023-07-24 07:08:50,111 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, UNASSIGN 2023-07-24 07:08:50,111 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8a3e53128463099081b265102a53eead, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:08:50,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7ce18d1808671221f701bbc8d93940f1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:08:50,112 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182530111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182530111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182530111"}]},"ts":"1690182530111"} 2023-07-24 07:08:50,112 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182530111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690182530111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690182530111"}]},"ts":"1690182530111"} 2023-07-24 07:08:50,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 8a3e53128463099081b265102a53eead, server=jenkins-hbase4.apache.org,35087,1690182392228}] 2023-07-24 07:08:50,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 7ce18d1808671221f701bbc8d93940f1, server=jenkins-hbase4.apache.org,44417,1690182392314}] 2023-07-24 07:08:50,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 07:08:50,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a3e53128463099081b265102a53eead 2023-07-24 07:08:50,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a3e53128463099081b265102a53eead, disabling compactions & flushes 2023-07-24 07:08:50,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:50,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:50,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. after waiting 0 ms 2023-07-24 07:08:50,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:50,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:50,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ce18d1808671221f701bbc8d93940f1, disabling compactions & flushes 2023-07-24 07:08:50,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:50,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:50,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. after waiting 0 ms 2023-07-24 07:08:50,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:50,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:50,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:50,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:08:50,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead. 2023-07-24 07:08:50,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a3e53128463099081b265102a53eead: 2023-07-24 07:08:50,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:08:50,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1. 2023-07-24 07:08:50,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ce18d1808671221f701bbc8d93940f1: 2023-07-24 07:08:50,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a3e53128463099081b265102a53eead 2023-07-24 07:08:50,286 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8a3e53128463099081b265102a53eead, regionState=CLOSED 2023-07-24 07:08:50,286 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182530286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182530286"}]},"ts":"1690182530286"} 2023-07-24 07:08:50,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:50,287 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=7ce18d1808671221f701bbc8d93940f1, regionState=CLOSED 2023-07-24 07:08:50,287 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690182530287"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690182530287"}]},"ts":"1690182530287"} 2023-07-24 07:08:50,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 07:08:50,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 8a3e53128463099081b265102a53eead, server=jenkins-hbase4.apache.org,35087,1690182392228 in 175 msec 2023-07-24 07:08:50,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 07:08:50,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 7ce18d1808671221f701bbc8d93940f1, server=jenkins-hbase4.apache.org,44417,1690182392314 in 175 msec 2023-07-24 07:08:50,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a3e53128463099081b265102a53eead, UNASSIGN in 183 msec 2023-07-24 07:08:50,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 07:08:50,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7ce18d1808671221f701bbc8d93940f1, UNASSIGN in 183 msec 2023-07-24 07:08:50,294 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690182530294"}]},"ts":"1690182530294"} 2023-07-24 07:08:50,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 07:08:50,297 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 07:08:50,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 198 msec 2023-07-24 07:08:50,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 07:08:50,406 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 07:08:50,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,412 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,414 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35087] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,415 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,417 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,417 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,417 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:50,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:50,418 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 07:08:50,420 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,420 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:50,420 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,420 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:50,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 07:08:50,424 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:50,424 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead 2023-07-24 07:08:50,426 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/recovered.edits] 2023-07-24 07:08:50,426 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf, FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/recovered.edits] 2023-07-24 07:08:50,426 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,426 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:50,427 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 07:08:50,427 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-24 07:08:50,427 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 07:08:50,434 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf/80009836096b47d2b1f3162f1b4b7dfe to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/cf/80009836096b47d2b1f3162f1b4b7dfe 2023-07-24 07:08:50,435 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf/98eb3993ed8c40fa9645263eb79fb35b to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/cf/98eb3993ed8c40fa9645263eb79fb35b 2023-07-24 07:08:50,440 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead/recovered.edits/9.seqid 2023-07-24 07:08:50,442 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/recovered.edits/9.seqid to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1/recovered.edits/9.seqid 2023-07-24 07:08:50,443 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a3e53128463099081b265102a53eead 2023-07-24 07:08:50,443 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7ce18d1808671221f701bbc8d93940f1 2023-07-24 07:08:50,443 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 07:08:50,443 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 07:08:50,444 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 07:08:50,449 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072462cc78a0ae8d4c31bfbea55bc26c1954 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072462cc78a0ae8d4c31bfbea55bc26c1954 2023-07-24 07:08:50,450 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724645ce2aed34843ae9182bb8028900ff6 to hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724645ce2aed34843ae9182bb8028900ff6 2023-07-24 07:08:50,451 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 07:08:50,453 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,456 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 07:08:50,458 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 07:08:50,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 07:08:50,460 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182530460"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:50,460 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690182530460"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:50,462 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 07:08:50,462 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ce18d1808671221f701bbc8d93940f1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690182511157.7ce18d1808671221f701bbc8d93940f1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a3e53128463099081b265102a53eead, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690182511157.8a3e53128463099081b265102a53eead.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 07:08:50,462 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 07:08:50,462 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690182530462"}]},"ts":"9223372036854775807"} 2023-07-24 07:08:50,472 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 07:08:50,474 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 66 msec 2023-07-24 07:08:50,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 07:08:50,522 INFO [Listener at jenkins-hbase4.apache.org/46799] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 07:08:50,531 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 07:08:50,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 07:08:50,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34101] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 07:08:50,568 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:50452 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-498184315_1 at /127.0.0.1:60760 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5541 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-498184315_1 at /127.0.0.1:34270 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:60778 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1488416207) connection to jenkins-hbase4.apache.org/172.31.14.131:36451 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fbb8b71-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1778551598_17 at /127.0.0.1:45508 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=645 (was 480) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 181), AvailableMemoryMB=4329 (was 5061) 2023-07-24 07:08:50,568 WARN [Listener at jenkins-hbase4.apache.org/46799] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 07:08:50,568 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 07:08:50,591 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:08:54,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690182401381_0007_000001 (auth:SIMPLE) 2023-07-24 07:08:55,875 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 07:09:04,714 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:09:18,833 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 07:09:18,834 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:09:18,943 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 07:09:18,951 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 07:09:18,954 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 07:09:18,964 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 07:09:19,068 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 07:09:19,068 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 07:09:19,068 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 07:09:19,068 INFO [Listener at jenkins-hbase4.apache.org/46799] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 07:09:19,068 DEBUG [Listener at jenkins-hbase4.apache.org/46799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dd3367c to 127.0.0.1:60170 2023-07-24 07:09:19,068 DEBUG [Listener at jenkins-hbase4.apache.org/46799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,069 DEBUG [Listener at jenkins-hbase4.apache.org/46799] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 07:09:19,069 DEBUG [Listener at jenkins-hbase4.apache.org/46799] util.JVMClusterUtil(257): Found active master hash=806650342, stopped=false 2023-07-24 07:09:19,069 DEBUG [Listener at jenkins-hbase4.apache.org/46799] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,069 DEBUG [Listener at jenkins-hbase4.apache.org/46799] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 07:09:19,069 INFO [Listener at jenkins-hbase4.apache.org/46799] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:09:19,071 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:19,072 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:19,072 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:19,072 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 07:09:19,072 INFO [Listener at jenkins-hbase4.apache.org/46799] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 07:09:19,072 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:09:19,072 DEBUG [Listener at jenkins-hbase4.apache.org/46799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5308c337 to 127.0.0.1:60170 2023-07-24 07:09:19,072 DEBUG [Listener at jenkins-hbase4.apache.org/46799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:19,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:19,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:19,073 INFO [Listener at jenkins-hbase4.apache.org/46799] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35087,1690182392228' ***** 2023-07-24 07:09:19,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 07:09:19,074 DEBUG [Listener at jenkins-hbase4.apache.org/46799] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,074 INFO [Listener at jenkins-hbase4.apache.org/46799] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 07:09:19,074 INFO [Listener at jenkins-hbase4.apache.org/46799] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44417,1690182392314' ***** 2023-07-24 07:09:19,074 DEBUG [Listener at jenkins-hbase4.apache.org/46799] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,074 INFO [Listener at jenkins-hbase4.apache.org/46799] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 07:09:19,074 INFO [RS:0;jenkins-hbase4:35087] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 07:09:19,074 INFO [Listener at jenkins-hbase4.apache.org/46799] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43877,1690182392360' ***** 2023-07-24 07:09:19,075 INFO [RS:1;jenkins-hbase4:44417] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 07:09:19,075 DEBUG [Listener at jenkins-hbase4.apache.org/46799] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,075 INFO [Listener at jenkins-hbase4.apache.org/46799] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 07:09:19,075 INFO [RS:1;jenkins-hbase4:44417] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 07:09:19,075 INFO [RS:2;jenkins-hbase4:43877] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 07:09:19,075 INFO [RS:1;jenkins-hbase4:44417] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 07:09:19,075 INFO [RS:0;jenkins-hbase4:35087] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 07:09:19,075 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 07:09:19,075 INFO [RS:2;jenkins-hbase4:43877] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 07:09:19,075 INFO [RS:2;jenkins-hbase4:43877] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 07:09:19,075 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:09:19,075 DEBUG [RS:2;jenkins-hbase4:43877] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28bdfcd8 to 127.0.0.1:60170 2023-07-24 07:09:19,075 DEBUG [RS:2;jenkins-hbase4:43877] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,075 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 07:09:19,075 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 07:09:19,075 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(3305): Received CLOSE for c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:09:19,075 INFO [RS:0;jenkins-hbase4:35087] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 07:09:19,079 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(3305): Received CLOSE for 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:09:19,079 INFO [RS:2;jenkins-hbase4:43877] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 07:09:19,079 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:09:19,079 INFO [RS:2;jenkins-hbase4:43877] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 07:09:19,079 DEBUG [RS:0;jenkins-hbase4:35087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00dc9dab to 127.0.0.1:60170 2023-07-24 07:09:19,079 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:09:19,081 DEBUG [RS:1;jenkins-hbase4:44417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x075cb637 to 127.0.0.1:60170 2023-07-24 07:09:19,081 DEBUG [RS:1;jenkins-hbase4:44417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3ce2b34a27d3aafd626a5c3e7bbec46, disabling compactions & flushes 2023-07-24 07:09:19,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:09:19,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 12db6da8a942ac73eca936629445f8ac, disabling compactions & flushes 2023-07-24 07:09:19,079 INFO [RS:2;jenkins-hbase4:43877] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 07:09:19,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:09:19,081 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 07:09:19,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:09:19,081 DEBUG [RS:0;jenkins-hbase4:35087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. after waiting 0 ms 2023-07-24 07:09:19,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:09:19,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:09:19,082 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 07:09:19,082 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 07:09:19,082 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-24 07:09:19,082 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1478): Online Regions={c3ce2b34a27d3aafd626a5c3e7bbec46=hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46.} 2023-07-24 07:09:19,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c3ce2b34a27d3aafd626a5c3e7bbec46 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 07:09:19,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. after waiting 0 ms 2023-07-24 07:09:19,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:09:19,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 12db6da8a942ac73eca936629445f8ac 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 07:09:19,083 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 07:09:19,083 DEBUG [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1504): Waiting on c3ce2b34a27d3aafd626a5c3e7bbec46 2023-07-24 07:09:19,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 07:09:19,092 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 07:09:19,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 07:09:19,094 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1478): Online Regions={12db6da8a942ac73eca936629445f8ac=hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac.} 2023-07-24 07:09:19,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 07:09:19,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 07:09:19,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 07:09:19,094 DEBUG [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1504): Waiting on 12db6da8a942ac73eca936629445f8ac 2023-07-24 07:09:19,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 07:09:19,096 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:19,116 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:19,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/.tmp/l/84825d1131014e1d92ff3c116091ab70 2023-07-24 07:09:19,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/.tmp/info/8a9ba12db2934bdcb272a479908622e5 2023-07-24 07:09:19,173 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:19,175 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/.tmp/info/673f40a2c1a541eb83c8c456f5cf6307 2023-07-24 07:09:19,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 673f40a2c1a541eb83c8c456f5cf6307 2023-07-24 07:09:19,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/.tmp/info/8a9ba12db2934bdcb272a479908622e5 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/info/8a9ba12db2934bdcb272a479908622e5 2023-07-24 07:09:19,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84825d1131014e1d92ff3c116091ab70 2023-07-24 07:09:19,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/.tmp/l/84825d1131014e1d92ff3c116091ab70 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/l/84825d1131014e1d92ff3c116091ab70 2023-07-24 07:09:19,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/info/8a9ba12db2934bdcb272a479908622e5, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 07:09:19,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c3ce2b34a27d3aafd626a5c3e7bbec46 in 116ms, sequenceid=6, compaction requested=false 2023-07-24 07:09:19,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84825d1131014e1d92ff3c116091ab70 2023-07-24 07:09:19,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/l/84825d1131014e1d92ff3c116091ab70, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 07:09:19,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 12db6da8a942ac73eca936629445f8ac in 125ms, sequenceid=18, compaction requested=false 2023-07-24 07:09:19,215 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/.tmp/rep_barrier/3c9cb44771294a79b4ecc1f92a1b0862 2023-07-24 07:09:19,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/namespace/c3ce2b34a27d3aafd626a5c3e7bbec46/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 07:09:19,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:09:19,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3ce2b34a27d3aafd626a5c3e7bbec46: 2023-07-24 07:09:19,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690182395241.c3ce2b34a27d3aafd626a5c3e7bbec46. 2023-07-24 07:09:19,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/acl/12db6da8a942ac73eca936629445f8ac/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 07:09:19,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:09:19,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 12db6da8a942ac73eca936629445f8ac: 2023-07-24 07:09:19,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690182396187.12db6da8a942ac73eca936629445f8ac. 2023-07-24 07:09:19,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c9cb44771294a79b4ecc1f92a1b0862 2023-07-24 07:09:19,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/.tmp/table/f1fd0bc9a82d4d1db16b41b0aec413d5 2023-07-24 07:09:19,242 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1fd0bc9a82d4d1db16b41b0aec413d5 2023-07-24 07:09:19,243 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/.tmp/info/673f40a2c1a541eb83c8c456f5cf6307 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/info/673f40a2c1a541eb83c8c456f5cf6307 2023-07-24 07:09:19,247 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 673f40a2c1a541eb83c8c456f5cf6307 2023-07-24 07:09:19,248 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/info/673f40a2c1a541eb83c8c456f5cf6307, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 07:09:19,248 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/.tmp/rep_barrier/3c9cb44771294a79b4ecc1f92a1b0862 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/rep_barrier/3c9cb44771294a79b4ecc1f92a1b0862 2023-07-24 07:09:19,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c9cb44771294a79b4ecc1f92a1b0862 2023-07-24 07:09:19,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/rep_barrier/3c9cb44771294a79b4ecc1f92a1b0862, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 07:09:19,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/.tmp/table/f1fd0bc9a82d4d1db16b41b0aec413d5 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/table/f1fd0bc9a82d4d1db16b41b0aec413d5 2023-07-24 07:09:19,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1fd0bc9a82d4d1db16b41b0aec413d5 2023-07-24 07:09:19,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/table/f1fd0bc9a82d4d1db16b41b0aec413d5, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 07:09:19,262 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 168ms, sequenceid=131, compaction requested=false 2023-07-24 07:09:19,283 DEBUG [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 07:09:19,287 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 07:09:19,291 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 07:09:19,291 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 07:09:19,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 07:09:19,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 07:09:19,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 07:09:19,293 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44417,1690182392314; all regions closed. 2023-07-24 07:09:19,294 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35087,1690182392228; all regions closed. 2023-07-24 07:09:19,315 DEBUG [RS:1;jenkins-hbase4:44417] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs 2023-07-24 07:09:19,315 DEBUG [RS:0;jenkins-hbase4:35087] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs 2023-07-24 07:09:19,315 INFO [RS:1;jenkins-hbase4:44417] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44417%2C1690182392314:(num 1690182394590) 2023-07-24 07:09:19,315 INFO [RS:0;jenkins-hbase4:35087] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35087%2C1690182392228:(num 1690182394589) 2023-07-24 07:09:19,316 DEBUG [RS:1;jenkins-hbase4:44417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,316 DEBUG [RS:0;jenkins-hbase4:35087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,316 INFO [RS:1;jenkins-hbase4:44417] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:19,316 INFO [RS:0;jenkins-hbase4:35087] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:19,316 INFO [RS:1;jenkins-hbase4:44417] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 07:09:19,316 INFO [RS:0;jenkins-hbase4:35087] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 07:09:19,316 INFO [RS:1;jenkins-hbase4:44417] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 07:09:19,316 INFO [RS:1;jenkins-hbase4:44417] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 07:09:19,316 INFO [RS:1;jenkins-hbase4:44417] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 07:09:19,316 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:19,318 INFO [RS:0;jenkins-hbase4:35087] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 07:09:19,318 INFO [RS:0;jenkins-hbase4:35087] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 07:09:19,318 INFO [RS:0;jenkins-hbase4:35087] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 07:09:19,318 INFO [RS:1;jenkins-hbase4:44417] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44417 2023-07-24 07:09:19,318 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:19,319 INFO [RS:0;jenkins-hbase4:35087] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35087 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35087,1690182392228 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:09:19,326 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44417,1690182392314 2023-07-24 07:09:19,329 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44417,1690182392314] 2023-07-24 07:09:19,329 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44417,1690182392314; numProcessing=1 2023-07-24 07:09:19,331 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44417,1690182392314 already deleted, retry=false 2023-07-24 07:09:19,331 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44417,1690182392314 expired; onlineServers=2 2023-07-24 07:09:19,331 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35087,1690182392228] 2023-07-24 07:09:19,331 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35087,1690182392228; numProcessing=2 2023-07-24 07:09:19,332 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35087,1690182392228 already deleted, retry=false 2023-07-24 07:09:19,332 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35087,1690182392228 expired; onlineServers=1 2023-07-24 07:09:19,379 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 07:09:19,379 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 07:09:19,429 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,429 INFO [RS:0;jenkins-hbase4:35087] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35087,1690182392228; zookeeper connection closed. 2023-07-24 07:09:19,429 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:35087-0x101962713520001, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,429 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@279f581f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@279f581f 2023-07-24 07:09:19,484 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43877,1690182392360; all regions closed. 2023-07-24 07:09:19,490 DEBUG [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs 2023-07-24 07:09:19,490 INFO [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43877%2C1690182392360.meta:.meta(num 1690182394791) 2023-07-24 07:09:19,495 DEBUG [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/oldWALs 2023-07-24 07:09:19,495 INFO [RS:2;jenkins-hbase4:43877] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43877%2C1690182392360:(num 1690182394602) 2023-07-24 07:09:19,495 DEBUG [RS:2;jenkins-hbase4:43877] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,495 INFO [RS:2;jenkins-hbase4:43877] regionserver.LeaseManager(133): Closed leases 2023-07-24 07:09:19,495 INFO [RS:2;jenkins-hbase4:43877] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 07:09:19,495 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:19,496 INFO [RS:2;jenkins-hbase4:43877] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43877 2023-07-24 07:09:19,498 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43877,1690182392360 2023-07-24 07:09:19,498 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 07:09:19,499 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43877,1690182392360] 2023-07-24 07:09:19,499 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43877,1690182392360; numProcessing=3 2023-07-24 07:09:19,500 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43877,1690182392360 already deleted, retry=false 2023-07-24 07:09:19,500 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43877,1690182392360 expired; onlineServers=0 2023-07-24 07:09:19,500 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34101,1690182390803' ***** 2023-07-24 07:09:19,500 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 07:09:19,501 DEBUG [M:0;jenkins-hbase4:34101] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71298bdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 07:09:19,501 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34101,1690182390803 2023-07-24 07:09:19,501 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34101,1690182390803; all regions closed. 2023-07-24 07:09:19,501 DEBUG [M:0;jenkins-hbase4:34101] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 07:09:19,501 DEBUG [M:0;jenkins-hbase4:34101] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 07:09:19,501 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 07:09:19,501 DEBUG [M:0;jenkins-hbase4:34101] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 07:09:19,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690182394051] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690182394051,5,FailOnTimeoutGroup] 2023-07-24 07:09:19,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690182394052] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690182394052,5,FailOnTimeoutGroup] 2023-07-24 07:09:19,501 INFO [M:0;jenkins-hbase4:34101] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 07:09:19,501 INFO [M:0;jenkins-hbase4:34101] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 07:09:19,501 INFO [M:0;jenkins-hbase4:34101] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 07:09:19,502 DEBUG [M:0;jenkins-hbase4:34101] master.HMaster(1512): Stopping service threads 2023-07-24 07:09:19,502 INFO [M:0;jenkins-hbase4:34101] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 07:09:19,502 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 07:09:19,502 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 07:09:19,502 ERROR [M:0;jenkins-hbase4:34101] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 07:09:19,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 07:09:19,503 INFO [M:0;jenkins-hbase4:34101] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 07:09:19,503 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 07:09:19,503 DEBUG [M:0;jenkins-hbase4:34101] zookeeper.ZKUtil(398): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 07:09:19,503 WARN [M:0;jenkins-hbase4:34101] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 07:09:19,503 INFO [M:0;jenkins-hbase4:34101] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 07:09:19,503 INFO [M:0;jenkins-hbase4:34101] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 07:09:19,504 DEBUG [M:0;jenkins-hbase4:34101] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 07:09:19,504 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:19,504 DEBUG [M:0;jenkins-hbase4:34101] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:19,504 DEBUG [M:0;jenkins-hbase4:34101] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 07:09:19,504 DEBUG [M:0;jenkins-hbase4:34101] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:19,504 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.12 KB 2023-07-24 07:09:19,516 INFO [M:0;jenkins-hbase4:34101] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/49f3c98c2afa467c9faaa0233a596396 2023-07-24 07:09:19,519 INFO [M:0;jenkins-hbase4:34101] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49f3c98c2afa467c9faaa0233a596396 2023-07-24 07:09:19,520 DEBUG [M:0;jenkins-hbase4:34101] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/49f3c98c2afa467c9faaa0233a596396 as hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/49f3c98c2afa467c9faaa0233a596396 2023-07-24 07:09:19,524 INFO [M:0;jenkins-hbase4:34101] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49f3c98c2afa467c9faaa0233a596396 2023-07-24 07:09:19,524 INFO [M:0;jenkins-hbase4:34101] regionserver.HStore(1080): Added hdfs://localhost:38471/user/jenkins/test-data/5d71bd76-abfd-ad3c-8f85-33dcc5502b93/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/49f3c98c2afa467c9faaa0233a596396, entries=119, sequenceid=899, filesize=28.7 K 2023-07-24 07:09:19,525 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384923, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-07-24 07:09:19,527 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 07:09:19,527 DEBUG [M:0;jenkins-hbase4:34101] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 07:09:19,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,529 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:44417-0x101962713520002, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,529 INFO [RS:1;jenkins-hbase4:44417] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44417,1690182392314; zookeeper connection closed. 2023-07-24 07:09:19,529 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7baa6ed] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7baa6ed 2023-07-24 07:09:19,530 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 07:09:19,530 INFO [M:0;jenkins-hbase4:34101] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 07:09:19,530 INFO [M:0;jenkins-hbase4:34101] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34101 2023-07-24 07:09:19,533 DEBUG [M:0;jenkins-hbase4:34101] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34101,1690182390803 already deleted, retry=false 2023-07-24 07:09:19,629 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,629 INFO [RS:2;jenkins-hbase4:43877] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43877,1690182392360; zookeeper connection closed. 2023-07-24 07:09:19,629 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): regionserver:43877-0x101962713520003, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,630 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@720610df] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@720610df 2023-07-24 07:09:19,630 INFO [Listener at jenkins-hbase4.apache.org/46799] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 07:09:19,729 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,729 INFO [M:0;jenkins-hbase4:34101] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34101,1690182390803; zookeeper connection closed. 2023-07-24 07:09:19,730 DEBUG [Listener at localhost/34763-EventThread] zookeeper.ZKWatcher(600): master:34101-0x101962713520000, quorum=127.0.0.1:60170, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 07:09:19,731 WARN [Listener at jenkins-hbase4.apache.org/46799] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 07:09:19,737 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:19,841 WARN [BP-123631319-172.31.14.131-1690182386713 heartbeating to localhost/127.0.0.1:38471] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 07:09:19,841 WARN [BP-123631319-172.31.14.131-1690182386713 heartbeating to localhost/127.0.0.1:38471] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-123631319-172.31.14.131-1690182386713 (Datanode Uuid c19a7ffe-8b8f-4ff8-a3cd-d8e5ab7fd9f7) service to localhost/127.0.0.1:38471 2023-07-24 07:09:19,843 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data5/current/BP-123631319-172.31.14.131-1690182386713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:19,843 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data6/current/BP-123631319-172.31.14.131-1690182386713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:19,845 WARN [Listener at jenkins-hbase4.apache.org/46799] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 07:09:19,848 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:19,953 WARN [BP-123631319-172.31.14.131-1690182386713 heartbeating to localhost/127.0.0.1:38471] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 07:09:19,953 WARN [BP-123631319-172.31.14.131-1690182386713 heartbeating to localhost/127.0.0.1:38471] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-123631319-172.31.14.131-1690182386713 (Datanode Uuid 8da83f3f-7368-4c77-bc30-f3c94ba21e6a) service to localhost/127.0.0.1:38471 2023-07-24 07:09:19,954 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data3/current/BP-123631319-172.31.14.131-1690182386713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:19,954 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data4/current/BP-123631319-172.31.14.131-1690182386713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:19,955 WARN [Listener at jenkins-hbase4.apache.org/46799] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 07:09:19,957 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:20,060 WARN [BP-123631319-172.31.14.131-1690182386713 heartbeating to localhost/127.0.0.1:38471] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 07:09:20,061 WARN [BP-123631319-172.31.14.131-1690182386713 heartbeating to localhost/127.0.0.1:38471] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-123631319-172.31.14.131-1690182386713 (Datanode Uuid c5095bb5-94be-4bf9-b472-4d4eaa417fed) service to localhost/127.0.0.1:38471 2023-07-24 07:09:20,061 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data1/current/BP-123631319-172.31.14.131-1690182386713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:20,062 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/922422c2-6e9f-7240-76ea-008ffee8fb57/cluster_91f85f83-1a17-c19e-0156-6a37a3470458/dfs/data/data2/current/BP-123631319-172.31.14.131-1690182386713] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 07:09:20,083 INFO [Listener at jenkins-hbase4.apache.org/46799] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 07:09:20,210 INFO [Listener at jenkins-hbase4.apache.org/46799] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 07:09:20,305 INFO [Listener at jenkins-hbase4.apache.org/46799] hbase.HBaseTestingUtility(1293): Minicluster is down