Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
LateMonk
/
LocalModels
like
1
GGUF
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
No model card
Downloads last month
-
GGUF
Model size
6B params
Architecture
lance
Hardware compatibility
Log In
to add your hardware
3-bit
Q3_K_M
4.62 GB
4-bit
Q4_K_S
3.73 GB
Q4_K_S
4.14 GB
Q4_K_M
4.96 GB
Q4_K_M
5.63 GB
Q4_K_M
3.43 GB
Q4_K_M
1.93 GB
Q4_K_M
2.71 GB
Q4_K_M
4.92 GB
Q4_K_M
2.84 GB
Q4_K_M
2.5 GB
Q4_K_M
2.5 GB
Q4_K_M
3.43 GB
8-bit
Q8_0
1.15 GB
Q8_0
1.96 GB
Q8_0
1.25 GB
Q8_0
950 MB
Q8_0
1.25 GB
Q8_0
512 MB
Q8_0
1.15 GB
16-bit
BF16
2.23 GB
DFLASH
32-bit
F32
3.81 GB
MTP
F32
3.81 GB
MTP
View +4 variants
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support