Hugging Face model: TheBloke/Yarn-Mistral-7B-64k-AWQ
Author: TheBloke
Created: 2023-11-02 16:41:28
Last modified: 2023-11-09 18:16:15
Pipeline: text-generation
Library: transformers
Likes: 4 | Downloads: 9
Tags: transformers, safetensors, mistral, text-generation, custom_code, en, dataset:emozilla/yarn-train-tokenized-16k-mistral, arxiv:2309.00071, base_model:NousResearch/Yarn-Mistral-7b-64k, base_model:quantized:NousResearch/Yarn-Mistral-7b-64k, license:apache-2.0, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: NousResearch/Yarn-Mistral-7b-64k
Card metadata:
base_model: NousResearch/Yarn-Mistral-7b-64k
datasets: emozilla/yarn-train-tokenized-16k-mistral
inference: no
language: en
library_name: transformers
license: apache-2.0
metrics: perplexity
model_creator: NousResearch
model_name: Yarn Mistral 7B 64K
model_type: mistral
prompt_template: {prompt}

quantized_by: TheBloke