[PD-569] updated robots.txt per Seth's request.