Added robots.txt

Exclude certain URLs from search engines.
Added gitignore

Exclude certain files from getting into the site source repo.