Heartburn is a common side effect of prednisone when you take it for too long or take too much in a single dose.