It depends on the terms of your account. Federal law sets a minimum penalty on early withdrawals from CDs, but there is no maximum penalty. If you withdraw money within the first six days after deposit, the penalty is at least seven days' simple interest.