use robots txt radio button fixes.