Web crawler with basic functionality