View Source Crawler.Fetcher.Recorder (Crawler v1.2.0)

Records information about each crawl for internal use.

Summary

Functions

Records information about each crawl for internal use.

Stores page data in Crawler.Store.DB for internal or external consumption.

Functions

Records information about each crawl for internal use.

Examples

iex> Recorder.record(url: "url1", depth: 2)
{:ok, %{depth: 3, url: "url1"}}

iex> Recorder.record(url: "url2", depth: 2)
iex> Store.find("url2")
%Page{url: "url2"}

Stores page data in Crawler.Store.DB for internal or external consumption.