Travis finnaly worked OK with its own copy of scipy and numpy.
Testing now with PyPI version of those packages.