Yes, some people can leave you even if they love you. The reason does not necessarily involve your worthiness in their sight, but it has much to do with their own psychological and emotional state. People may leave you even if they love you because of the fear of abandonment, intimacy, or lack of independence.