Add most of the crawler tests