Allow updateing vif_id_on_device

We're going to store the quantum port_id here so we don't have to make
the call to quantum on delete.