contao/test — Issue #150: add cron.php, flash.php to robots.txt
Author: fbender
Created: 2011-11-29 04:38:16+00:00
State: open
Labels: Feature, frontend

cron.php & flash.php should not be indexed by crawlers. Adding those to the robots.txt file should help.

--- _Originally created on September 30th, 2008, at 07:08pm (ID 150)_