Feature Optimizations

• Crawler file export
• Adjusted task retrieval time to 1 second
• Exception handling when FileDriver is closed
• Automatic cleaning of tasks older than 30 days
• Homepage data query optimization
• Message notification optimization
• Upgraded Gin version
• Added support for MatterMost message notification
• Added priority to crawlers and scheduled tasks
• Front-end loading performance optimization

Community

If you find Crawlab helpful for your daily development or company, please consider giving it a star on Github. If you encounter any issues, feel free to raise them as issues on Github. Additionally, you are welcome to contribute to Crawlab development. You can also join the Crawlab technical discussion group on WeChat by adding tikazyq1 to exchange ideas and experiences with other developers regarding technical development and deployment.

References

• Official Website: https://www.crawlab.cn
• Documentation: https://docs.crawlab.cn
• GitHub Repository: https://github.com/crawlab-team/crawlab
• Demo: https://demo.crawlab.cn/