Hugging Face model: TheBloke/Yarn-Mistral-7B-128k-AWQ
Author: TheBloke
Created: 2023-11-02 17:54:52
Last modified: 2023-11-09 18:16:14
Pipeline: text-generation
Library: transformers
Likes: 72 | Downloads: 65
Tags: transformers, safetensors, mistral, text-generation, custom_code, en, dataset:emozilla/yarn-train-tokenized-16k-mistral, arxiv:2309.00071, base_model:NousResearch/Yarn-Mistral-7b-128k, base_model:quantized:NousResearch/Yarn-Mistral-7b-128k, license:apache-2.0, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: NousResearch/Yarn-Mistral-7b-128k
Card metadata:
base_model: NousResearch/Yarn-Mistral-7b-128k
datasets: emozilla/yarn-train-tokenized-16k-mistral
inference: no
language: en
library_name: transformers
license: apache-2.0
metrics: perplexity
model_creator: NousResearch
model_name: Yarn Mistral 7B 128K
model_type: mistral
prompt_template: {prompt}

quantized_by: TheBloke