Unclaimed project
Are you a maintainer of stormcrawler? Claim this project to take control of your public changelog and roadmap.
Changelog
A scalable, mature and versatile web crawler based on Apache Storm
Apache StormCrawler 3.5.1 provides updated documentation.
Additionally, multiple dependencies were upgraded, core tests improved, and deprecated code cleaned up, enhancing overall stability and maintainability.
Apache StormCrawler 3.5.0 decouples Selenium from the core module (#1604), improving modularity and reducing unnecessary dependencies. The release also introduces an advanced metadata filtering system (#1647) that supports complex logical operations like key=>val OR (key2=>val2 AND key3=>val3), addressing issue #711.
Additionally, multiple dependencies were upgraded, core tests...
TextExtractor Renamed and RefactoredApplies to: Users who directly used, extended, or overrode TextExtractor via textextractor.class in crawler.yaml.
What Changed:
TextExtractor has been renamed and is now an interface.JSoupTextExtractor.TextExtractor...