Renamed crawler to spider since it is only used to gather intial links, split WebPage out into the mode