Fix bug that results in SRV resolver not returning enough servers