While there is no legal limit on the number of points you can buy, there are federal and state laws that cap how much you can pay in closing costs. As a result, most lenders won’t let you purchase more than 4 points.