crawlie v0.3.1 Crawlie.Options

Summary

Functions

The default options set by Crawlie. If you set your own values in Crawlie.crawl/3, they will override the defaults

Deep-merges the provided options, keeping the default values for not overridden keys

Keys of the options that can be used to tune a GenStage Flow partition performance

Returns the passed-in options merged with the defaults

Returns the options with Crawlie.HttpClient.MockClient set as the HTTP client

Functions

core_count()
defaults()
defaults() :: Keyword.t

The default options set by Crawlie. If you set your own values in Crawlie.crawl/3, they will override the defaults.

get_pqueue_module(options)
merge(default, overriding)
merge(default :: Keyword.t, overriding :: Keyword.t) :: Keyword.t

Deep-merges the provided options, keeping the default values for not overridden keys

Works for nested keyword lists

partition_options()
partition_options() :: Keyword.t

Keys of the options that can be used to tune a GenStage Flow partition performance

with_defaults(options)
with_defaults(Keyword.t) :: Keyword.t

Returns the passed-in options merged with the defaults.

The provided options take precedence over the defaults if there are any common keys.

with_mock_client(options)
with_mock_client(Keyword.t) :: Keyword.t

Returns the options with Crawlie.HttpClient.MockClient set as the HTTP client.