add hooks for robots tag
add defaults for robots tag