There is no direct evidence to suggest that caffeine consumption is linked to belly fat. However, excessive consumption of high-calorie coffee drinks or adding sugar to coffee can contribute to overall weight gain, including in the belly area.