Could you add:

Replaces: foreman-mysql
Provides: foreman-mysql
Conflicts: foreman-mysql

to the mysql2 section? That way users get a smooth upgrade.