You typically have to wait seven months after closing your FHA mortgage before you can refinance to a conventional loan. A streamline refinance, also offered by the FHA, features a quicker application process than conventional mortgage refinancing.