Add feature to easily disable agent email output

Ref Redmine#5848