Finish web crawl

Notes:
    - The fact that the type of the arguments is not specified in the method signature makes it harder to figure the solution