Crawler v1.1.1 Crawler.Fetcher.UrlFilter

A placeholder module that lets all URLs pass through.

Link to this section Summary

Functions

Whether to pass through a given URL.

Link to this section Functions

Link to this function

filter(url, opts)

Whether to pass through a given URL.

  • true for letting the url through
  • false for rejecting the url