Technically, there are no limits to the number of mortgage points you can buy down. However, your lender and the mortgage type may put limits on your ability to buy points. If you have money to spare, you may benefit more from applying the money to your down payment or setting it aside for emergencies.