fixed missing host issue for parsing urls for robots.txt checker, and added rating meta tag to feed