In reality, this is going to depend on your playstyle and individual preferences. Personally, I stuck with a particular horse I specced and kitted out around mid-game. I could've potentially sought out a faster one, but I was happy with what I had. The faster and stronger horses provide a benefit, but it's not a huge one.