Abandonment issues stem from a fear of loneliness, which can be a phobia or a form of anxiety. These issues can affect your relationships and often stem from a childhood loss. Other factors that turn loss into abandonment issues include environmental and medical factors, genetics, and brain chemistry.