Unclaimed project

Are you a maintainer of crawlee? Claim this project to take control of your public changelog and roadmap.

Changelog

crawlee

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

apify/crawlee·

22k1.2kTypeScriptApache-2.0

·Website

apifyautomationcrawlercrawlingheadlessheadless-chrome+11

Last updated about 2 months ago

Back to changelog

NewAI EnhancedNovember 10, 2025

v3.15.3

3.15.3 (2025-11-10)

Fixes

Fixed retry awaiting in _timeoutAndRetry to prevent race conditions
CLI now accepts project names starting with numbers
AdaptivePlaywrightCrawler now uses shared enqueue links wrapper for consistency

Features

Custom userAgent now supported when respectRobotsTxtFile is enabled

3.15.3 (2025-11-10)

Bug Fixes

await retries inside _timeoutAndRetry (#3206) (9c1cf6d), closes /github.com/apify/crawlee/pull/3188#discussion_r2410256271
cli: support creating projects with names that start with a number (#3219) (3f37845), closes #3213
use shared enqueue links wrapper in AdaptivePlaywrightCrawler (#3188) (9569d19)