|
--- |
|
tags: |
|
- llama2 |
|
- llama-2-7b-chat-hf |
|
language: |
|
- en |
|
--- |
|
# Llama-2-7b-chat-hf-GGUF |
|
Based on Llama-2-7b-chat-hf by Meta. This version has been converted to: |
|
- GGML_VERSION = "gguf" |
|
- Conversion = float16 |
|
- Quantization method = q4_k_s (Uses Q4_K for all tensors - "q" + the number of bits + the variant used ) |
|
- |
|
Learn More: |
|
|
|
Llama 2 is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. |
|
- This is the repository for the 7B fine-tuned model, optimized for dialogue use cases and converted for the Hugging Face Transformers format. |
|
|
|
Model Details |
|
- Model Developers: Meta |
|
- Input: Models input text only. |
|
- Output: Models generate text only. |
|
- Model Dates: Llama 2 was trained between January 2023 and July 2023. |
|
- Status: This is a static model trained on an offline dataset. Future versions of the tuned models will be released as we improve model safety with community feedback. |
|
- Model Architecture: Llama 2 is an auto-regressive language model that uses an optimized transformer architecture.The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align to human preferences for helpfulness and safety. |
