Avoid breaking dovecot certificate when upgrading from 3.2