colly

Tons of bug fixes & little improvements & updated dependencies

What's Changed

• Added new project that uses Colly by @twiny in https://github.com/gocolly/colly/pull/525
• adding docker-slim to the list of open source projects using Colly by @kcq in https://github.com/gocolly/colly/pull/526
• update coursera example by @ysung6 in https://github.com/gocolly/colly/pull/537
• Update openedx_...

• HTTP tracing support
• New callback: OnResponseHeader
• Queue fixes
• New collector option: Collector.CheckHead
• Proxy fixes
• Fixed POST revisit checking
• Updated dependencies

• Breaking change: Change Collector.RedirectHandler member to Collector.SetRedirectHandler function
• Go module support
• Collector.HasVisited method added to be able to check if an url has been visited
• Collector.SetClient method introduced
• HTMLElement.ChildTexts method added
• New user agents
• Multiple bugfixes

• Compatibility with the latest htmlquery package
• New request shortcut for HEAD requests
• Check URL availibility before visiting
• Fix proxy URL value
• Request counter fix
• Minor fixes in examples

• Appengine integration takes context.Context instead of http.Request (API change)
• Added "Accept" http header by default to every request
• Support slices of pointers and structs in unmarshal
• Fixed a race condition in queues
• ForEachWithBreak method added to HTMLElement
• Added a local file example
• Support gzip decompression of response bodies
• Don't share waitgroup when clo...