Review your loan agreement, which is the contract between you and the bank, to determine if it specifies the circumstances that could result in a prepayment penalty.
You may also contact the bank and ask about the prepayment penalty. If you believe the bank should not have charged a prepayment penalty, you can try requesting a refund for the prepayment penalty. You can also file a written complaint with the OCC's Customer Assistance Group.