Added db index on name and tags fields
Added robots.txt response