If you don’t enroll in a Medicare drug plan when you’re first eligible, you may pay a late enrollment penalty if you join later. You’ll have to pay this penalty for as long as you have Medicare prescription drug coverage. However, you won’t pay the penalty if you get Extra Help Keep in mind that this applies to Part D late penalties and not Part B late penalties.