View Source SpiderMan.Pipeline.Counter (spider_man v0.4.7)

msg counter for component

usage

Usage

settings = [
  *_options: [
    pipelines: [SpiderMan.Pipeline.Counter | {SpiderMan.Pipeline.Counter, scope}]
  ],
  ...
]

Support for all component: downloader | spider | item_processor.

scope

Scope

  • :common | [scope: :common]: save counter to common_pipeline_tid.

  • :pipeline | [scope: :pipeline]: save counter to pipeline_tid.

common_pipeline_tid use by all component, pipeline_tid only use by one component.

Link to this section Summary

Link to this section Functions