In most cases, you can tell the bank or credit union in advance that you’d like funds to be transferred to an account once the CD matures versus opting for a rollover. You can usually also decide during the grace period. However, you may have to pay a penalty if you wait too long to withdraw your funds or close your CD. This is most likely to occur after the grace period has ended, and your CD already rolled over or auto-renewed.