GPT4

I have created a project that runs gpt4 through an open resource "mindsdb". It runs with an api like oobabooga, except there is no streaming mode.

The project is compatible with Sillytavern and TavernAi. To launch, insert the link "[located in the logs of this container]" as the Blocking API url of the Text Gen Webui interface (ooba).

Duplicate this space to skip the queue

To clone this project, you will need to create an account on mindsdb. Then run the code there

CREATE MODEL mindsdb.gpt4 -- mindsdb.[yourmodelname]
PREDICT response -- What we want from model  a response!
USING -- Using WHAT?
engine = 'openai', -- OpenAI Engine
max_tokens = 6000, -- Adjusted max token size to 6k, you can make also temperature and more stuff...
-- api_key = demo instances already have one
model_name = 'gpt-4', -- you can also use text-davinci-003 or gpt-3.5-turbo
prompt_template = '{{text}}';

Then paste the login and password into secrets. The project will start.