Remove numpy and scipy from `tests_requires`

This is a nuisance with travis-ci since the specified deps are a higher version than what travis-ci provides.