Additionally, many flavored and sweetened almond kinds of milk are high in sugar. Too much sugar can increase your risk of weight gain, dental cavities, and other chronic conditions.