ignoring output file
added bunch of comments in code
starting to bring back the url checking bits