LUN-406. Solved "cross site promotion" behavior :)
Review and merge 'origin/LUN-406' into develop

The robots.txt should generate the appropriate sitemap
directive for it's own site.

Conflicts:
	robots/templates/robots/rule_list.html