Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
XelotX
/
Meta-Llama-3.1-70B-Instruct-XelotX-_Quants
like
0
GGUF
conversational
Model card
Files
Files and versions
Community
1
Deploy
Use this model
No model card
Downloads last month
81
GGUF
Model size
70.6B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
26.4 GB
3-bit
Q3_K_S
30.9 GB
Q3_K_M
34.3 GB
Q3_K_L
37.1 GB
4-bit
Q4_K_S
40.3 GB
Q4_0
40 GB
Q4_1
44.3 GB
Q4_K_M
42.5 GB
5-bit
Q5_K_S
48.7 GB
Q5_0
48.7 GB
Q5_1
53 GB
Q5_K_M
49.9 GB
6-bit
Q6_K
57.9 GB
8-bit
Q8_0
75 GB
16-bit
BF16
141 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
XelotX/Meta-Llama-3.1-70B-Instruct-XelotX-_Quants
Meta-Llama-3(.1-3)
Collection
18 items
โข
Updated
Jan 20