How to use Camel with open source Large Language Models?

#1
by JBHF - opened

I would like to experiment with using Camel with open source Large Language Models instead of having to OpenAI model with a key. Is this possible? How exactly can I do this?

oobabooga TGWUI has an openAI module implementing the openAI API with local LLMs, it should be mostly a drop-in replacement for any code that uses the official openAI APIs

Sorry for very late response. @JBHF https://github.com/camel-ai/camel/blob/master/examples/open_source_models/role_playing_with_open_source_model.py here you can find how to use camel with open-source models.

Sign up or log in to comment