updated the crawler so it doesn't count failed downloads ( or other skipped urls like PDFs ) as scraped while processing a target url
removed master targets fiel and added a targets example csv.