📟 Relay v0.1 (Mistral Nemo 2407): 4-bit (bnb)

This model page includes the 4-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month: 14

Safetensors

Model size

6.97B params

Tensor type

F32

FP16

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-4bit

Base model

mistralai/Mistral-Nemo-Base-2407

Finetuned

danlou/relay-v0.1-Mistral-Nemo-2407

Quantized

(3)

this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-4bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-4bit

📟 Relay

Collection

Turning base LLMs into IRCs, for more natural and versatile chat applications. • 5 items • Updated 5 days ago