Config directory is created if it doesn't exist