Several updates to deployment process

Updated MANIFEST file which includes translations (which now require you to run the new compile_translation command in fabric to any existing VMs you want to deploy to).

Added robots.txt

Cleaned up requirements.txt. Do not think we need our own yet?

Bumped version.

ping @inspirehep/labs-scrum