Getting the crawler to do something (no real deduplication yet)