Skip to content

yelp-check: set User-Agent when checking hrefs

Andy Holmes requested to merge andyholmes/yelp-tools:andyholmes/yelp-check-href-useragent into master

It's pretty common for external links to point to other documentation, such as Wikis, but these also commonly reject scrapers.

Set the User-Agent when checking external hrefs, so that it doesn't error on 403 responses.

Merge request reports