fixed link to file crashing bot

url.py won't attempt to read the page into BeautifulSoup if the
content-type header is not text/html