Bug fix: Make sure configuration directory exists (reported by @grimborg)