Ignore connections with a null address and port

This is based on a patch I found from opsview. I modified it
slightly but the premise is the same. Not sure when if ever
this would happen but I will trust that they ran into this
issue before and this fixed that issue.