Unclaimed project
Are you a maintainer of colly? Claim this project to take control of your public changelog and roadmap.
Changelog
colly
Elegant Scraper and Crawler Framework for Golang
Back to changelogTons of bug fixes & little improvements & updated dependencies
What's Changed
- Added new project that uses Colly by @twiny in https://github.com/gocolly/colly/pull/525
- adding docker-slim to the list of open source projects using Colly by @kcq in https://github.com/gocolly/colly/pull/526
- update coursera example by @ysung6 in https://github.com/gocolly/colly/pull/537
- Update openedx_courses.go by @lingt-xyz in https://github.com/gocolly/colly/pull/539
- feat: support Stop() in queue by @PalanQu in https://github.com/gocolly/colly/pull/531
- Fix invalid base URL assignment by @dasshield in https://github.com/gocolly/colly/pull/549
- Add context.Context support by @WGH- in https://github.com/gocolly/colly/pull/548
- Fix handling of redirected URLs in OnResponseHeaders by @WGH- in https://github.com/gocolly/colly/pull/561
- Fix race on count fields of Collector type by @shubham14bajpai in https://github.com/gocolly/colly/pull/563
- SetProxyFunc: fix proxies rotation by @wowinter13 in https://github.com/gocolly/colly/pull/567
- Update xkcd_store.go by @BigManing in https://github.com/gocolly/colly/pull/570
- Updated xmlquery to close a known security vulnerability by @ijomeli in https://github.com/gocolly/colly/pull/582
Fix default User-Agent when using custom headers by @WGH- in https://github.com/gocolly/colly/pull/592Update openedx_courses.go by @BigManing in https://github.com/gocolly/colly/pull/576Add httpBackend cache response callback by @slashapp in https://github.com/gocolly/colly/pull/574Update README.md by @seversky in https://github.com/gocolly/colly/pull/595Change the type assersion for Attr by @moritamori in https://github.com/gocolly/colly/pull/588Update User-Agent strings for Desktop by @guessi in https://github.com/gocolly/colly/pull/605add quote crawler using colly by @eval-exec in https://github.com/gocolly/colly/pull/603Fix golint issues by @waltton in https://github.com/gocolly/colly/pull/620Replace Travis with GitHub Actions by @alexhraber in https://github.com/gocolly/colly/pull/669Use github.com/nlnwa/whatwg-url for URL parsing by @WGH- in https://github.com/gocolly/colly/pull/673Fix Async ignoring its arguments by @ljbink in https://github.com/gocolly/colly/pull/652fix: generated code has compile error by @darjun in https://github.com/gocolly/colly/pull/629moving filterings to one function (checkFilters) and use it in case of redirect too by @joelazar in https://github.com/gocolly/colly/pull/638Fix Contributing.md link by @SaladinoBelisario in https://github.com/gocolly/colly/pull/641Work around invalid URL encoding in path by @WGH- in https://github.com/gocolly/colly/pull/675Host & Custom Header Support by @ErikOwen in https://github.com/gocolly/colly/pull/691Code cleanup by @WGH- in https://github.com/gocolly/colly/pull/678Add GitHub issue templates and nudge questions to Stack Overflow by @WGH- in https://github.com/gocolly/colly/pull/702Fix redirects ignoring AllowURLRevisit=false by @WGH- in https://github.com/gocolly/colly/pull/681Bump whatwg-url version by @WGH- in https://github.com/gocolly/colly/pull/713fix some typos by @cuishuang in https://github.com/gocolly/colly/pull/736feat: Add MaxRequests paramete by @guilhem in https://github.com/gocolly/colly/pull/722Update CI configuration by @WGH- in https://github.com/gocolly/colly/pull/749upgrade Cascadia version by @kinoute in https://github.com/gocolly/colly/pull/650Bump golang.org/x/net from 0.0.0-20220114011407-0dd24b26b47d to 0.7.0 by @dependabot in https://github.com/gocolly/colly/pull/756Support websites redirecting to the same page when AllowURLRevisit is disabled by @WGH- in https://github.com/gocolly/colly/pull/763Update User-Agent strings for 2023 by @guessi in https://github.com/gocolly/colly/pull/765Fix data races by @WGH- in https://github.com/gocolly/colly/pull/771Replaced deprecated io/ioutil package with proper implementations of … by @zachary-walters in https://github.com/gocolly/colly/pull/785Bump golang.org/x/net from 0.7.0 to 0.17.0 by @dependabot in https://github.com/gocolly/colly/pull/789put accept header before OnRequest by @k4lizen in https://github.com/gocolly/colly/pull/786Fix Bug: retry scrape will lost POST requestData by @Shinku-Chen in https://github.com/gocolly/colly/pull/794scrapper -> scraper Update README.md by @ideabrian in https://github.com/gocolly/colly/pull/809Test on Go 1.22, drop old versions by @WGH- in https://github.com/gocolly/colly/pull/810Bump google.golang.org/protobuf from 1.24.0 to 1.33.0 by @dependabot in https://github.com/gocolly/colly/pull/807Implement content sniffing for HTML parsing by @WGH- in https://github.com/gocolly/colly/pull/808Add headers/ua to robots.txt request by @makew0rld in https://github.com/gocolly/colly/pull/838doc: mention that OnScraped executes after OnHTML and OnXML by @aladmit in https://github.com/gocolly/colly/pull/832New Contributors
- @twiny made their first contribution in https://github.com/gocolly/colly/pull/525
- @kcq made their first contribution in https://github.com/gocolly/colly/pull/526
- @ysung6 made their first contribution in https://github.com/gocolly/colly/pull/537
- @lingt-xyz made their first contribution in https://github.com/gocolly/colly/pull/539
- @PalanQu made their first contribution in https://github.com/gocolly/colly/pull/531
- @dasshield made their first contribution in https://github.com/gocolly/colly/pull/549
- @shubham14bajpai made their first contribution in https://github.com/gocolly/colly/pull/563
- @wowinter13 made their first contribution in https://github.com/gocolly/colly/pull/567
- @BigManing made their first contribution in https://github.com/gocolly/colly/pull/570
- @ijomeli made their first contribution in https://github.com/gocolly/colly/pull/582
- @slashapp made their first contribution in https://github.com/gocolly/colly/pull/574
- @seversky made their first contribution in https://github.com/gocolly/colly/pull/595
- @moritamori made their first contribution in https://github.com/gocolly/colly/pull/588
- @guessi made their first contribution in https://github.com/gocolly/colly/pull/605
- @eval-exec made their first contribution in https://github.com/gocolly/colly/pull/603
- @waltton made their first contribution in https://github.com/gocolly/colly/pull/620
- @alexhraber made their first contribution in https://github.com/gocolly/colly/pull/669
- @ljbink made their first contribution in https://github.com/gocolly/colly/pull/652
- @darjun made their first contribution in https://github.com/gocolly/colly/pull/629
- @joelazar made their first contribution in https://github.com/gocolly/colly/pull/638
- @SaladinoBelisario made their first contribution in https://github.com/gocolly/colly/pull/641
- @ErikOwen made their first contribution in https://github.com/gocolly/colly/pull/691
- @cuishuang made their first contribution in https://github.com/gocolly/colly/pull/736
- @guilhem made their first contribution in https://github.com/gocolly/colly/pull/722
- @kinoute made their first contribution in https://github.com/gocolly/colly/pull/650
- @dependabot made their first contribution in https://github.com/gocolly/colly/pull/756
- @zachary-walters made their first contribution in https://github.com/gocolly/colly/pull/785
- @k4lizen made their first contribution in https://github.com/gocolly/colly/pull/786
- @Shinku-Chen made their first contribution in https://github.com/gocolly/colly/pull/794
- @ideabrian made their first contribution in https://github.com/gocolly/colly/pull/809
- @makew0rld made their first contribution in https://github.com/gocolly/colly/pull/838
- @aladmit made their first contribution in https://github.com/gocolly/colly/pull/832
Full Changelog: https://github.com/gocolly/colly/compare/v2.1.0...v2.2.0