New
Browsertrix Crawler v1.11.2
What's Changed
- warcio update + add links discovered from autoclick by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/952
- ensure redirects are followed for sitemap, robots, other requests converted from fetch() by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/955
- Fix sitemap done check by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/956
- deps: update browser 1.86.146 by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/958
- bug(normalize): normalize urls for seeds, address array-valued headers by @badgersec in https://github.com/webrecorder/browsertrix-crawler/pull/959
- Apply pageExtraDelay after successful direct fetch by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/961
New Contributors
- @badgersec made their first contribution in https://github.com/webrecorder/browsertrix-crawler/pull/959
Full Changelog: https://github.com/webrecorder/browsertrix-crawler/compare/v1.11.1...v1.11.2