The cheapest horse breeds to buy include Arabians, Thoroughbreds, and quarter horses. But the prices can vary significantly depending on the age, training level, and pedigree.