funkspector v0.9.1 Funkspector.TextSitemapScraper
Provides a method to scrape a text sitemap, given its URL.
Link to this section Summary
Functions
Fetches the given URL, follows redirections, and returns the data scraped from the text lines.
Link to this section Functions
Link to this function
scrape(original_url, options \\ %{})
Fetches the given URL, follows redirections, and returns the data scraped from the text lines.