langchain use

#4
by sagu7 - opened

Hey! how to use this model with langchain can you provide me an example?

You'd need to make a custom agent which uses code similar to the example code in the README to load the model using AutoGPTQ.

I believe it's pretty easy, but I don't have any code on hand as I've not used LangChain much myself yet.

Hi sagu7 did you figure out how to use langchain with it? I would like to use langchain to give the model memory. But it is not working:(

Sign up or log in to comment