Attempt to optimize TravisCI build time.

Most time is spent building dependencies. Removing matplotlib and the GRIB API from the dependencies makes the build faster without compromising on which tests can be run.