Model Card for Llama2-7b-HF-NF4-QLORA_V2
Model Details
This model is a NF4 quantized version of the meta-llama/Llama-2-7b-hf model. The model was fine-tuned on the dataset timdettmers/openassistant-guanaco using the QLoRA technique
- Developed by: Ted Whooley
- Library: Transformers, NF4
- Model type: llama
- Model name: Llama2-7b-HF-NF4-QLORA_V2
- Pipeline tag: text-generation
- Qunatized by: twhoool02
- Language(s) (NLP): en
- License: other
- Downloads last month
- 2
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.