Spaces:
Running
Running
# GPT4 | |
I have created a project that runs gpt4 through an open resource "[mindsdb](https://cloud.mindsdb.com/)". It runs with an api like [oobabooga](https://github.com/oobabooga/text-generation-webui), except there is no streaming mode. | |
The project is compatible with Sillytavern and TavernAi. To launch, insert the link "[located in the logs of this container]" as the Blocking API url of the Text Gen Webui interface (ooba). | |
--- | |
## [Duplicate this space to skip the queue](https://huggingface.co/spaces/antonovmaxim/gpt4?duplicate=true) | |
To clone this project, you will need to create an account on [mindsdb](https://cloud.mindsdb.com/). Then run the code there | |
```sql | |
CREATE MODEL mindsdb.gpt4 -- mindsdb.[yourmodelname] | |
PREDICT response -- What we want from model a response! | |
USING -- Using WHAT? | |
engine = 'openai', -- OpenAI Engine | |
max_tokens = 6000, -- Adjusted max token size to 6k, you can make also temperature and more stuff... | |
-- api_key = demo instances already have one | |
model_name = 'gpt-4', -- you can also use text-davinci-003 or gpt-3.5-turbo | |
prompt_template = '{{text}}'; | |
``` | |
Then paste the login and password into secrets. The project will start. | |