Fix bug which could cause resolver to return too many targets when doing SRV resolution