Add default config, cleanup cachedir