Changed the crawler so it dont save all links in a list