funkspector v0.9.1 Funkspector.TextSitemapScraper

Provides a method to scrape a text sitemap, given its URL.

Link to this section Summary

Functions

Fetches the given URL, follows redirections, and returns the data scraped from the text lines.

Link to this section Functions

Link to this function

scrape(original_url, options \\ %{})

Fetches the given URL, follows redirections, and returns the data scraped from the text lines.