Fix upsert bug when source and target have different ColumnModifiers