Withdrawing the funds used to purchase your CD before the term is complete will subject you to an early withdrawal penalty. The longer the CD term, the larger the penalty. While there are no-penalty CDs available, their rates tend to be lower than those of conventional CDs.