You can take your horse as far as the Gerudo Canyon Stable. Unfortunately, this is as far as your horse can go. Once you get to the end of the canyon that enters the desert, you'll have to leave your horse.