Remove old local addresses from peer store

This prevents a scenario where we used a different bind address in the
past and our raft server attempts to connect to itself, going into an
error loop.