View Source Crawler.Fetcher.Recorder (Crawler v1.2.0)
Records information about each crawl for internal use.
Summary
Functions
Records information about each crawl for internal use.
Stores page data in Crawler.Store.DB
for internal or external consumption.
Functions
Records information about each crawl for internal use.
Examples
iex> Recorder.record(url: "url1", depth: 2)
{:ok, %{depth: 3, url: "url1"}}
iex> Recorder.record(url: "url2", depth: 2)
iex> Store.find("url2")
%Page{url: "url2"}
Stores page data in Crawler.Store.DB
for internal or external consumption.