There is no limit to how many times you can get a physician mortgage, though some lenders will place limits. For example, some lenders might only offer these loans for the first five or 10 years after you leave medical school or residency.