Remove roles when subject destroyed, fixes #14

Note that the role was already being removed when the object was destroyed
because of the `dependent: :destroy` on the role association, we needed to add
the destroy callback for the subject side.