added integration test for crawling external urls