Unset the field. (You can mix both `$set` and `$unset` in one query, no?)