fix public folder gitignore, add robots.txt
add information to README