If servers are passed they shouod overwrite defaults

This is one of the rare cases where merging defaults isn't desirable