Model Card for Mistral-7B-Instruct-NF4
Model Details
This model is a NF4 quantized version of the mistralai/Mistral-7B-Instruct-v0.2 model.
- Developed by: Ted Whooley
- Library: Transformers, NF4
- Model type: mistral
- Model name: Mistral-7B-Instruct-NF4
- Pipeline tag: text-generation
- Qunatized by: twhoool02
- Language(s) (NLP): en
- License: other
- Downloads last month
- 91
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
Model tree for twhoool02/Mistral-7B-Instruct-NF4
Base model
mistralai/Mistral-7B-Instruct-v0.2