Provide more control over the crawler results