Adjust remote paths and filenames for new Times site layout.
Ignore robots.txt.