TST: speed up TravisCI tests of scipy.special, by installing gmpy2.

Gain is ~230 seconds on my machine (will be more on TravisCI).
Merge pull request #3681 from rgommers/speedup-tests

MAINT: install gmpy2 in travis-ci to speed up tests