Before revision:  We theoretically prove that a popular choice of contrastive loss is equivalently reducing the exposure bias via inverse propensity scoring , which provides a new perspective on the effectiveness of contrastive learning.
After revision:  We theoretically prove that a popular choice of contrastive loss is equivalently reducing the exposure bias via inverse propensity weighting , which provides a new perspective on the effectiveness of contrastive learning.