improving mapping to googlebot and disallowing craling on /backend/crawler
Merge remote-tracking branch 'origin/develop' into develop