Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mlx-community
/
Llama-3.3-70B-Instruct-4bit
like
22
Follow
MLX Community
2.84k
Text Generation
Transformers
Safetensors
PyTorch
MLX
8 languages
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
4-bit precision
License:
llama3.3
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
Group-Size of 32?
#3
by
vgoklani
- opened
10 days ago
Discussion
vgoklani
10 days ago
Possible to get this with a group-size of 32 instead of 64? Thanks!
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
