Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
leafspark
/
Llama-3-Orca-1.0-8B-GGUF
like
1
Text Generation
Transformers
GGUF
English
Inference Endpoints
License:
llama-3-license (other)
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Llama-3-Orca-1.0-8B-GGUF
Llama-3-Orca-1.0-8B-GGUF
Quant of
https://huggingface.co/Locutusque/Llama-3-Orca-1.0-8B
f32
f16
Q8_0
Q4_K_M
Q2_K
Downloads last month
185
GGUF
Model size
8.03B params
Architecture
llama
2-bit
Q2_K
4-bit
Q4_K_M
5-bit
Q5_K_M
8-bit
Q8_0
16-bit
F16
Inference API
Text Generation
Examples
Compute
This model can be loaded on Inference API (serverless).
JSON Output
Maximize
Collection including
leafspark/Llama-3-Orca-1.0-8B-GGUF
Llama 3 Experiments
Collection
3 items
•
Updated
May 20