House-breaking your goat is very easy as long as the goat is willing to be house trained. Take your goat outside the minute it wakes up. Use slow and gentle movement when approaching your goat or it will run. Say a command like "go potty" as you take the goat out.