python setup.py build / test fails

I get errors when I try to run `python setup.py test` or `python setup.py build`:
https://gist.github.com/cdeil/121d7d90003d627f0613

@keflavich Do you want to make this an affiliated Astropy package and maintain it, or would it maybe make sense to combine this with [python-reprojection](https://github.com/astrofrog/python-reprojection)?

cc @astrofrog