Hugging Face's logo

midoriinko
/
magnum-v4-123b-jp-imatrix

Text Generation
GGUF
imatrix
Inference Endpoints
conversational
Model card Files Community
1

iQ3_M

#1
by tomgm - opened
Discussion
tomgm

Please also quantize the iQ3_M, which is the best in a 64GB memory environment.

midoriinko
 Owner

Added and done :)

Sign up or log in to comment