contao/import — Issue #150: add cron.php, flash.php to robots.txt
Author: fbender
Created: 2011-11-29 15:46:16+00:00
State: closed
Labels: Feature, frontend

cron.php & flash.php should not be indexed by crawlers. Adding those to the robots.txt file should help.

--- _Originally created on September 30th, 2008, at 07:08pm (ID 150)_