Add robots.txt to block crawling
Remove unnecessary files from bootstrap