This is repo hosts quantized versions of the following models: https://huggingface.co/fireworks-ai/firefunction-v1
Quantization was done with this script: https://github.com/CharlesMod/quantizeHFmodel
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.