Text Generation
Transformers
GGUF
Inference Endpoints

Can u make measurement.json for exl2 quantization?

#1
by Apel-sin - opened

Hi!
Can I ask you to make measurement.json for exl2 quantization? My hardware setup freezes when measurement :(

Sign up or log in to comment