Remove an unnecessary optimization that can cause more trouble than it's worth - just try all the addresses that are given to us.

Refs #4870