Down payments on conventional loans for primary residences can be as low as 3%, but some lenders require 20% or more for second homes.continue reading