Send User-Agent
Accept any application Content-Type header
Count exceptions as failed tests
Rejigged the loop, URL validation, force HTTP