contao/issues — Issue #150: add cron.php, flash.php to robots.txt
Author: importer
Created: 2011-11-24 12:18:35+00:00
State: open
Labels: Feature, frontend

cron.php & flash.php should not be indexed by crawlers. Adding those to the robots.txt file should help.

--- _Originally created by FloB on September 30th, 2008, at 07:08pm (ID 150)_