The first step is acknowledging, accepting, and acting on the feelings by apologizing. You can also seek therapy to get more help if they are overwhelming. Guilt can be part of other mental health problems.