address: fix endianness check

This was defaulting to big endian if byte order was not defined.

Reported by Philippe Groarke.