It was first included as a bonus track in the European version of the "In the Zone" DVD.
Britney Spears je pesem »I've Just Begun (Having My Fun)« na začetku nameravala izdati preko svojega četrtega glasbenega albuma, "In the Zone" (2003).