Unclaimed project
Are you a maintainer of crawlee? Claim this project to take control of your public changelog and roadmap.
Changelog
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Last updated about 2 months ago
_timeoutAndRetry to prevent race conditionsAdaptivePlaywrightCrawler now uses shared enqueue links wrapper for consistencyuserAgent now supported when respectRobotsTxtFile is enabledNote: Version bump only for package @crawlee/root
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
This is the repo for Vue 2. For Vue 3, go to https://github.com/vuejs/core
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.