When removing a group, attempt to stop it first