Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
NyxKrage
/
LLM-Model-VRAM-Calculator
like
171
Running
App
Files
Files
Community
5
New cache sizes
#5
by
Anthonyg5005
- opened
10 days ago
Discussion
Anthonyg5005
10 days ago
exllamav2 now has new cache sizes, Q6 and Q8. FP8 may be removed soon
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
