Remove cache configuration from travis to fix build

* Not sure why this causes build failures, but it seems to affect
  spec coverage.