It's not ideal at all, but good enough for now.

At some point I suspect we may want to make scipy a full-fledged requirement (more and more scientists are using scientific Python distributions anyhow, so it's not too big of a hurdle).  But for now it's nice to keep it optional.