Penalties differ based on the bank, the length of the term, the interest rate, and how much you withdraw. Typically, the penalty is at least one month’s worth of interest.