Set the XDG_CACHE_HOME env to the cache dir during build