Added robots.txt and noindex & nofollow to default layout

Signed-off-by: DanielDimitrov <dimitrov.dan@gmail.com>