The word albatross is sometimes used metaphorically to mean a psychological burden that feels like a curse.