[FIXED JENKINS-24329] Update Go crawler to handle download site changes.

The download page now provides direct, absolute URLs and we're now more lenient
about picking up links from the page, as the filename regex will handle things.