Add robots.txt
Add sitemap.xml

Includes site pages, does not include site posts as
separate pages.
Define changefreq for frequently changed pages