No. Federal law prohibits prepayment penalties on adjustable-rate mortgages. You can refinance or pay off the loan without penalty. However, refinancing will require paying closing costs again.