There are many ways to embeddings of text using BERT/Roberta. We will use sentence-transformers here to get embeddings. There are many pre-trained models finetuned on the NLI dataset.