Travis: only delete the sympy dir for doctests

But keep it for building documentation, because it is needed for that.