togethercomputer

/

m2-bert-80M-8k-retrieval

like 29

I found it runs on CPU by default.

model = AutoModelForSequenceClassification.from_pretrained(
            pretrained_model_name_or_path=model_path,
            trust_remote_code=True,
        )
        
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model.eval().to(device)