Adds tests with and without numpy installed
Removes extraneous imports from setup.py