added robots txt
added preredner for seo optimization