Read directly into the unsafe buffer.