Make sure that config directory exists