add robots.txt and friendly link