respecting the users option to disallow user profile search eng crawling