improve robot and intranet detection; suppress email for non-intranet clients