Added basic files that browser and crawlers try and access. robots.txt with allowing all access and all user agents. and line in layout to stop browsers trying to get the favicon.
updating favicon
Added opengraph and twitter card tags.