Only try to unpack binary data when we've actually received some