Change setup.py not to import poppy before it's installed
AstroPy tests if NumPy is installed during setup, even though we don't need it then (astropy/package-template#107)