Clean up old files and config options