contao/import — Issue #2225: Pages Showing in sitemap.xml
Author: importer
Created: 2011-11-29 19:14:29+00:00
State: open
Labels: Feature, frontend

Hi Leo,

If I have chosen a page to be "no index, follow" or "no index, no follow", the page still shows up in my sitemap.xml. It's weird that I would not want the page indexed but it's added into my sitemap.xml file.

Right now, a page is determined if it shows up in your sitemap.xml file if you have "do not search" checked. I'm thinking there are the rare cases where you would want a page to be internally searched but not to show up in search engines. In these cases you could still use the "no index" option and setup disallow's in the robots.txt, it's just funny that you would still submit it in your sitemap file.

Two options to determine the pages that show in the sitemap.xml:
1) When "no index, follow" or "no index, no follow" is chosen, the file will not be included in the sitemap.xml
2) Create a new option in site structure for "remove from sitemap.xml"

--- _Originally created by Justin on July 1st, 2010, at 06:02pm (ID 2225)_