Don't install a stripped-down Pandoc

There's no point in building Pandoc without http-conduit, since Hakyll
requires http-conduit anyway.
Remove caching configuration

It's only available on Travis Pro