Remove support for Numpy 1.5

Since there seems to be consensus on doing this, we should go through and update the minimum version and remove any backward-compatibility hacks that exist in various places.
Is this safe to remove since it's ``<=``?