Crawler v0.3.0 Crawler.Fetcher.UrlFilter

A placeholder module that let all URLs pass through.

Link to this section Summary

Functions

Whether to pass through a given URL.

  • true for letting the url through.
  • false for rejecting the url

Link to this section Functions

Link to this function filter(url, opts)

Whether to pass through a given URL.

  • true for letting the url through.
  • false for rejecting the url.