Bear in mind that cortisol levels are high at three times of the day, not just early in the morning, according to a 2009 study. So the best times to drink coffee — or caffeine in general — is between 10 a.m. and noon, and between 2 p.m. and 5 p.m.