There is a segfault whenever I call numpy functions.

I'm going to try taking things apart until it goes away.  This commit
is immediately before that process.