Fats do slow digestion, small amounts of healthy fat won't negatively impact recovery. Have your primary focus be on carbohydrates and protein and include fats in your meals to follow after.