Question: Please enumerate the key technical concepts in related research prior to CLIP, as explained by the presenter.
Answer: Weakly supervised learning, Transformer-based language modeling, Contrastive learning