Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
XelotX
/
Meta-Llama-3.1-70B-Instruct-240807-XelotX-_Quants
like
0
GGUF
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
34
GGUF
Model size
70.6B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
26.4 GB
3-bit
Q3_K_S
30.9 GB
Q3_K_M
34.3 GB
Q3_K_L
37.1 GB
4-bit
Q4_K_S
40.3 GB
Q4_0
40 GB
Q4_1
44.3 GB
Q4_K_M
42.5 GB
5-bit
Q5_K_S
48.7 GB
Q5_0
48.7 GB
Q5_1
53 GB
Q5_K_M
49.9 GB
6-bit
Q6_K
57.9 GB
8-bit
Q8_0
75 GB
16-bit
BF16
141 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
XelotX/Meta-Llama-3.1-70B-Instruct-240807-XelotX-_Quants
Meta-Llama-3(.1-3)
Collection
18 items
โข
Updated
Jan 20