crawlie v1.0.0 API Reference
Modules
The simple Elixir web crawler
Defines the struct representing a url’s state in the system
Wraps the Erlang pqueue
:pqueue
, :pqueue2
, :pqueue3
and :pqueue4
modules
functionality for easier use in Elixir and easier swapping of the implementations
Defines the struct representing a page retrieved by the http client
Tracks the crawling statistics of a particular crawling session