NousResearch

/

Hermes-2-Pro-Llama-3-8B

like 393

im trying to use "NousResearch/Hermes-2-Pro-Llama-3-8B" with my own endpoint but unfortunately I keep on getting the same error message: "AttributeError: 'InferenceClient' object has no attribute 'bind'"

I tried to run it both with InferenceClient and InferenceAPI, but none of them seem to work. Any idea why?

Here is the reference documentation from crewai: https://docs.crewai.com/how-to/LLM-Connections/#ollama-integration-ex-for-using-llama-2-locally