added host parameter in robots txt