SpiderMan.Component.Downloader behaviour (spider_man v0.4.0) View Source

Download request.

Life cycle of request:

  1. insert requests to ets of downloader component.
  2. component's producer get pass out to processes.
  3. processes handle message.
    1. handle by pre pipelines.
    2. call Requester.request/3.
    3. handle by post pipelines.
  4. pass out message.
    1. if success, pass out to Spider component's ets.
    2. if failed, maybe try again.

Link to this section Summary

Link to this section Callbacks

Link to this callback

process_name(name, base_name)

View Source

Specs

process_name(Broadway.name(), base_name :: String.t()) :: Broadway.name()

Link to this section Functions

Link to this function

process_name(broadway_name, base_name)

View Source