Remove support for Numpy 1.5

Since there seems to be consensus on doing this, we should go through and update the minimum version and remove any backward-compatibility hacks that exist in various places.
Likewise, the `from distutils import version` is no longer used in this module.