Fix delete handling for <physical_device, vn>

add logic to handle update when we have multiple physical device present.