Scrapex
Fast and robust web crawling tool in Elixir. Powered by job processing library - Exq
Features
- Minimal and easy to use DSL - examples.
- PhantomJS rendering via Hound.
- Queue, concurrent processing, retries, fault-tolerance - all thanks to Exq and Elixir/OTP.
Installation
def deps do
[
{:scrapex, "~> 0.1.0"}
]
end