Hugging Face model: TheBloke/Yarn-Llama-2-70B-32k-AWQ
Author: TheBloke
Created: 2023-11-20 21:45:12
Last modified: 2023-11-21 00:44:12
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 9
Tags: transformers, safetensors, llama, text-generation, custom_code, en, dataset:emozilla/yarn-train-tokenized-8k-llama, arxiv:2309.00071, base_model:NousResearch/Yarn-Llama-2-70b-32k, base_model:quantized:NousResearch/Yarn-Llama-2-70b-32k, license:apache-2.0, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: NousResearch/Yarn-Llama-2-70b-32k
Card metadata:
base_model: NousResearch/Yarn-Llama-2-70b-32k
datasets: emozilla/yarn-train-tokenized-8k-llama
inference: no
language: en
library_name: transformers
license: apache-2.0
metrics: perplexity
model_creator: NousResearch
model_name: Yarn Llama 2 70B 32K
model_type: llama
prompt_template: {prompt}

quantized_by: TheBloke