[MAINT] Remove unneeded dependencies to speed-up Travis CI.

As the title says.