Handle gw removed and interface removed in delete_port

Change-Id: Ia44b7a26d66286ae21bd6155b15c78819384d1ca