But you might want to try your coffee black: Dairy or lactose intolerance can cause constipation in some people.