Create folder of conf if it doesn't exist.