You typically need at least 3% equity to refinance your mortgage, unless you’re eligible for a streamline refinance program through the FHA, VA or USDA. There are also programs available to homeowners to refinance an underwater home, meaning their outstanding mortgage balance is higher than their home’s value.