It's a sign of respect. In many cultures, avoiding eye contact is seen as a sign of respect. If someone doesn't look at you directly in the eyes, it could be because he or she is trying to show you his or her respect. Also, some people avoid eye contact because they feel uncomfortable or shy, or they don't want to be seen as aggressive or intimidating.