QuantFactory

/

Meta-Llama-3-8B-Instruct-GGUF

like 283

@alimography
First, host the quantized model using the Ollama framework. Then, create a Rasa custom action to make an API call to Ollama, retrieve the model response, and subsequently utter the LLM response.

how can I use this model in rasa pro calm edition?