funkspector v0.8.0 Funkspector
Funkspector is a web scraper that lets you extract data from web pages.
Link to this section Summary
Functions
Convenience method, this is just a shortcut for Funkspector.PageScraper.scrape/1
.
Convenience method, this is just a shortcut for Funkspector.SitemapScraper.scrape/1
.
Link to this section Functions
Link to this function
default_options()
Link to this function
page_scrape(url, options \\ %{})
Convenience method, this is just a shortcut for Funkspector.PageScraper.scrape/1
.
Examples
iex> { :ok, data } = Funkspector.page_scrape("http://example.com")
iex> data.host
"example.com"
Link to this function
sitemap_scrape(url, options \\ %{})
Convenience method, this is just a shortcut for Funkspector.SitemapScraper.scrape/1
.
Examples
iex> { :ok, data } = Funkspector.sitemap_scrape("http://validationhell.com/sitemap.xml")
iex> length data.locs
1014
iex> [ first | _ ] = data.locs
iex> first
"http://validationhell.com/"