a generic crawler for crawling the domain of your choice