Adjust the web crawler to cobweb gem