Those looking for a first-time horse will probably need to have anywhere from $1,500 to $3,000 in their budget for the purchase. You may be able to find a gem for less than this, but having that amount will give you the greatest number of choices. The more you have to spend, the more choices you will have.