added hack for forcing paths into robots.txt