In some cases, such as with a fearful horse, they may stare at you to try and assess whether you will hurt them or if you are a predator that will eat them. A horse that's being defensive may turn their face to you, raise their head, and stare at you to try and intimidate you.