handle case where beautifulsoup does not find a page title
fix missing titles on subsequent crawls
show url in link list
restructure project