SpiderMan.Component.Downloader (spider_man v0.3.4)

Download request.

Life cycle of request:

  1. insert requests to ets of downloader component.
  2. component's producer get pass out to processes.
  3. processes handle message.
    1. handle by pre pipelines.
    2. call Requester.request/3.
    3. handle by post pipelines.
  4. pass out message.
    1. if success, pass out to Spider component's ets.
    2. if failed, maybe try again.

Link to this section Summary

Link to this section Functions

Link to this function

start_link(options)