A lot of factors are related to causing intolerance for coffee in your body. You might be sensitive to caffeine or even allergic. Your genetics might be responsible, or your liver might not be able to metabolize caffeine.