Remove support for Numpy 1.5

Since there seems to be consensus on doing this, we should go through and update the minimum version and remove any backward-compatibility hacks that exist in various places.
With this line removed you can also remove the `from distutils import version` on line 8 of this file.