As you grow with this person, you may start to realize that they are rubbing you the wrong way. What may have started as a few irritations can quickly snowball into everything they do being an annoyance. Many divorced couples say that they knew the marriage was over when they couldn’t stand to be in the same room together.