Don't delete portals more than once.

Signed-off-by: Matt Benjamin <matt@linuxbox.com>