Preserve old behavior for initial retries

If this is an initial retry, meaning the active master is not
set yet, then do try to contact all masters. Otherwise, we can
assume that retry means there is a master failure.