Updating linkcrawler code to be shorter