Try caching cabal dir after installing dependencies.