Raise NoServerAvailable error when all servers are down

Also avoid connecting to all servers when you just need the primary