xfer: Don't use sockaddr_storage for address_length

Hopefully this addresses #25. I feel like I did this fix before for OS X so its not a total shot in the dark.