Switched to using apt-get to install sklearn to speed things up substantially with travis.