Petyr loved Catelyn Stark. When they were younger, he professed his feelings and got rejected. He never found love, even though he and Lysa kept having an affair.