Yes, you can, if you are a fan of nutmeg flavor. I personally think that nutmeg has a strong flavor and I do not add it in the recipe.