Fixes .htaccess misconfiguration.
Robots exclusion settings added.