Mortgage points can be deducted from your taxes if you meet certain criteria. In order for the points to be deductible, the loan must be used to purchase, build, or improve your primary residence. Additionally, the points must be paid to the lender at closing or when the loan is originated.