Robots.txt

Add comments about robots.txt and spelling fixes