You'll likely need a higher score than what was required for your first mortgage. Some lenders require scores of 660 or 680, while others require scores above 700. A few lenders allow scores as low as 620.