Fix random panic for missing SRV records

Fixes #1