tests: Don't clear existing caches with unit tests, set XDG_CACHE_HOME

https://bugzilla.gnome.org/show_bug.cgi?id=731681