You’d need to pay off the loan or refinance it to a non-USDA mortgage. Refinancing into a conventional loan lets homeowners stop paying mortgage insurance premiums if they own at least 20% of the home’s value as equity.