Revert "[PD-569] updated robots.txt per Seth's request."

Reverts DirectEmployers/MyJobs#954