Paleo is so controversial because of how restrictive it is. The diet eliminates several major food groups, including dairy and carbohydrates. Plus, an increased fat intake can impact cardiovascular health long-term.