MAINT: in setup.py, only catch ImportError for pandas.

See for example gh-617.
Merge pull request #621 from rgommers/setuppy-importerror

MAINT: in setup.py, only catch ImportError for pandas.