Crawler that discovers website pages and inputs.