A basic webcrawler is built, URL written to file and checked so they are not recrawled again