crawlie v1.0.0 Crawlie.Stats.Server.Data

Summary

Types

Crawling status

t()

Stats data returned by Crawlie.Stats.Server.get_stats/1

Functions

Returns time spent crawling (so far), in microseconds

Returns true if the crawling is finished

Types

status()
status() :: :ready | :crawling | :finished

Crawling status.

t()
t() :: %Crawlie.Stats.Server.Data{bytes_received: integer, content_types_dist: map, depths_dist: map, failed_fetch_uris: MapSet.t(<a href="https://hexdocs.pm/elixir/URI.html#t:t/0">URI.t</a>), failed_parse_uris: MapSet.t(<a href="https://hexdocs.pm/elixir/URI.html#t:t/0">URI.t</a>), retry_count_dist: map, status: status, status_codes_dist: map, uris_extracted: integer, uris_skipped: integer, uris_visited: integer, usec_spent_fetching: integer, utimestamp_finished: nil | integer, utimestamp_started: nil | integer}

Stats data returned by Crawlie.Stats.Server.get_stats/1.

Functions

elapsed_usec(data)

Returns time spent crawling (so far), in microseconds.

finished?(data)

Returns true if the crawling is finished

new()