Add back destroy fix unassign

this should be possible to replace with before_destroy callback, which is convention.