NousResearch
/

Hermes-2-Pro-Mistral-7B

Text Generation

function calling

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Update README.md

#3

by archit11 - opened Mar 14

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -281,7 +281,7 @@ Note: To use function calling, you should see the github repo above.
 import torch
 from transformers import AutoTokenizer, AutoModelForCausalLM
-from transformers import LlamaTokenizer, MixtralForCausalLM
 import bitsandbytes, flash_attn
 tokenizer = LlamaTokenizer.from_pretrained('NousResearch/Hermes-2-Pro-Mistral-7B', trust_remote_code=True)

 import torch
 from transformers import AutoTokenizer, AutoModelForCausalLM
+from transformers import LlamaTokenizer, MistralForCausalLM
 import bitsandbytes, flash_attn
 tokenizer = LlamaTokenizer.from_pretrained('NousResearch/Hermes-2-Pro-Mistral-7B', trust_remote_code=True)