Add support for Allow lines and Sitemap lines