Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
biology
medical
en
dataset:EleutherAI/pile
dataset:Open-Orca/OpenOrca
dataset:GAIR/lima
dataset:WizardLM/WizardLM_evol_instruct_V2_196k
arxiv:2309.09530
Eval Results
Inference Endpoints
has_space
text-generation-inference