As I understand it, this doesn't work yet for public repos: http://about.travis-ci.org/docs/user/caching/