Added tests for noindex/nofollow.