How to use afschowdhury/semantic-xlmr-bn with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("afschowdhury/semantic-xlmr-bn") sentences = [ "আমি বাংলায় গান গাই", "I sing in Bangla", "I sing in Bengali", "I sing in English", "আমি গান গাই না " ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [5, 5]
How to use afschowdhury/semantic-xlmr-bn with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("afschowdhury/semantic-xlmr-bn") model = AutoModel.from_pretrained("afschowdhury/semantic-xlmr-bn", device_map="auto")
SFconvertbot