API Reference Roboxir v0.1.1

Modules

Roboxir is a straightforward Robots.txt parser that lets you know if the crawler with specified name is legable to crawl a website. This parser has two functions, crawlable/2 and crawlable?/2