When it comes to sugar free vanilla lattes from coffee bean, the calorie content will vary depending on the size of the drink. A small sugar free vanilla latte from coffee bean contains around 100 calories, whereas a large one can have up to 200 calories. The majority of these calories come from the milk that is used to make the latte, with around 50-60% coming from fat.