created 2nd version of web crawler which finds all the links of a site withou repeating them