Part A late enrollment penalty If you have to buy Part A, and you don't buy it when you're first eligible for Medicare, your monthly premium may go up 10%. You'll have to pay the penalty for twice the number of years you didn't sign up.