Your lender should clearly explain any options you have for buying points, compared to funding your loan without points. To avoid points, simply tell your lender that you want to pay for a loan with no points.