Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
FlexingD
/
yarn-mistral-7B-64k-instruct-alpaca-cleaned-Q4
like
1
Text Generation
Transformers
Safetensors
mistral
custom_code
Inference Endpoints
text-generation-inference
8-bit precision
bitsandbytes
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Model Description
Model Description
Model type:
Text Generation
Language:
English
Finetuned from model:
NousResearch/Yarn-Mistral-7b-64k
Hardware Type:
Ryzen 4090
Hours used:
37hs
Downloads last month
17
Safetensors
Model size
7.24B params
Tensor type
F32
路
FP16
路
I8
路
Inference API
Text Generation
Examples
Compute
This model can be loaded on Inference API (serverless).
JSON Output
Maximize
Quantized from
NousResearch/Yarn-Mistral-7b-64k