Add a changelog entry
Also instrument the mailer action