Removed numpy from conda travis matrix.

@birdage another easy one...