add filter for robots
disallow suscriptions and users from crawlers
add div container
Merge branch 'master' into production