One of the core reasons for poor self-esteem is an unpleasant childhood. This happens when a child's parents, or any other person in authority in his or her life, were harsh and hostile. Low self-esteem can also be caused by poor academic achievement or peer bullying.