alphagov/trade-tariff-frontend — pull request #125 by macool (2014-04-11 16:04:59+00:00)
Title: Reduce crawler load

- Add `rel='nofollow'` on the links that do the filtering
- Add `X-Robots-Tag` header on historical pages

[pivotal story](https://www.pivotaltracker.com/n/projects/488191/stories/68707106)