Unclaimed project
Are you a maintainer of pyspider? Claim this project to take control of your public changelog and roadmap.
Changelog
A Powerful Spider(Web Crawler) System in Python.
scheduler.PAUSE_TIME (default: 5min) when last scheduler.FAIL_PAUSE_NUM (default: 10) task failed, and dispatch scheduler.UNPAUSE_CHECK_NUM (default: 3) tasks after scheduler.PAUSE_TIME. Project will resume if any one of last scheduler.UNPAUSE_CHECK_NUM tasks success.--splash-endpoint=http://splash:8050/executefrom projects import project support.user_agent parameter in self.crawl, you can set user-agent by headers though.connection_timeout not working issue.need_auth option not applied on webdav issue.AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
A feature-rich command-line audio/video downloader
Python tool for converting files and office documents to Markdown.
:octocat: 分享 GitHub 上有趣、入门级的开源项目。Share interesting, entry-level open source projects on GitHub.