CRM-11658 Releaser tweaks

Address notes/issues when running on sushi