Remove cached gems

@arfon these were added in https://github.com/github/linguist/commit/cd99ab2d6eb3262a296cb8b55de616647376abd5. Is there a reason these were added?