Don't crash if there is no address to associate

Rather, just to nothing. This prevents a crash we've seen in production at
Bonobos.