The guy will stare at you and hold it.
Because it feels awkward and disturbing to maintain eye contact, both of you will likely break the gaze and look away.