New
v1.3.0
- [Added]
:storeoption, defaults tonilto save memory usage - [Added]
:max_pagesoption - [Added]
Crawler.running?/1to check whether Crawler is running - [Improved] The queue is being supervised now
Full Changelog: https://github.com/fredwu/crawler/compare/v1.2.0...v1.3.0