Crawler v0.3.1 Crawler.Fetcher.UrlFilter

A placeholder module that lets all URLs pass through.

Link to this section Summary

Functions

Whether to pass through a given URL

Link to this section Functions

Link to this function filter(url, opts)

Whether to pass through a given URL.

  • true for letting the url through
  • false for rejecting the url