First, you will want to decide what breed of goat to get. After that, get a good idea of the supplies that your goats need as well as how much the goats will cost.