Before revision:  More importantly, the information-theoretic frameworkinspires us to propose a pre-training task based on contrastive learning.
After revision:  More importantly, inspired by the framework, we propose a new pre-training task based on contrastive learning.