Adding option to disallow robots