Edit model card

Llama-2-7B-Chat-GGUF

Original Model

meta-llama/Llama-2-7b-chat-hf

Run with Gaianet

Prompt template:

prompt template: stablelm-zephyr

Context size:

chat_ctx_size: 2048

Run with GaiaNet:

Downloads last month
16
GGUF
Model size
6.74B params
Architecture
llama

5-bit

Inference API
Unable to determine this model's library. Check the docs .