According to relationship therapist Aimee Hartstein, LCSW, as it turns out, the first year really is the hardest—even if you've already lived together. In fact, it often doesn't matter if you've been together for multiple years, the start of married life is still tricky.