AI-Engine
/

Mistral-Nemo-Instruct-2407-GGUF

Inference Endpoints

Model card Files Files and versions Community

AI-Engine commited on Jul 22

Commit

25e5e10

•

1 Parent(s): d42dc49

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -11,4 +11,6 @@ GGUF [llama.cpp](https://github.com/ggerganov/llama.cpp) quantized version of:
 <s>[INST]Provide some context and/or instructions to the model.[/INST]
 AI message goes here</s>
 [INST] The user’s message goes here [/INST]
-```

 <s>[INST]Provide some context and/or instructions to the model.[/INST]
 AI message goes here</s>
 [INST] The user’s message goes here [/INST]
+```
+Quant Version: [b3437](https://github.com/ggerganov/llama.cpp/releases/tag/b3437) with [imatrix](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384)