Remove mime_types usage from .travis.yml

As mail no longer uses mime/types, stop testing many different
versions on travis.  Also, remove the gemfiles directory, as it
is no longer needed.