browsertrix-crawler

What's Changed

• Fix default user-agent to not include minor version + set sec-ua-ch-* headers by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/962
• fix issues related to profile directory placed in /profile: by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/969
• add decompress() interceptor, support undici.request() without decompression + keep...

What's Changed

• add decompress() interceptor, support undici.request() without decompression + keep content-encoding if no decompression by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/970

Full Changelog: https://github.com/webrecorder/browsertrix-crawler/compare/v1.11.3...v1.11.4

What's Changed

• Fix default user-agent to not include minor version + set sec-ua-ch-* headers by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/962
• fix issues related to profile directory placed in /profile: by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/969

Full Changelog: https://github.com/webrecorder/browsertrix-crawler/compare/v1...

Initial Dedupe Beta Release (for internal testing)

Full Changelog: https://github.com/webrecorder/browsertrix-crawler/compare/v1.11.2...v1.12.0-beta.0

What's Changed

• warcio update + add links discovered from autoclick by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/952
• ensure redirects are followed for sitemap, robots, other requests converted from fetch() by @ikreymer in https://github.com/webrecorder/browsertrix-crawler/pull/955
• Fix sitemap done check by @ikreymer in https://github.com/webrecorder/browsertri...