instructions

blocking_api.py

@@ -113,6 +113,11 @@ def _run_server(port: int, share: bool = False):
     server = ThreadingHTTPServer((address, port), Handler)
 
     def on_start(public_url: str):
+        with open('main.md', 'r') as f:
+            text = f.read()
+        text = text.replace("[located in the logs of this container]", f"{public_url}/api")
+        with open('main.md', 'w') as f:
+            f.write(text)
         print(f'Starting non-streaming server at public url {public_url}/api')
 
     if share:

main.md

@@ -0,0 +1,22 @@
+# GPT4
+
+I have created a project that runs gpt4 through an open resource "[mindsdb](https://cloud.mindsdb.com/)". It runs with an api like [oobabooga](https://github.com/oobabooga/text-generation-webui), except there is no streaming mode. 
+
+The project is compatible with Sillytavern and TavernAi.  To launch, insert the link "[located in the logs of this container]" as the Blocking API url of the Text Gen Webui interface (ooba).
+
+---
+## [Duplicate this space to skip the queue](https://huggingface.co/spaces/antonovmaxim/gpt4?duplicate=true)
+
+To clone this project, you will need to create an account on [mindsdb](https://cloud.mindsdb.com/). Then run the code there
+```sql
+CREATE MODEL mindsdb.gpt4 -- mindsdb.[yourmodelname]
+PREDICT response -- What we want from model  a response!
+USING -- Using WHAT?
+engine = 'openai', -- OpenAI Engine
+max_tokens = 6000, -- Adjusted max token size to 6k, you can make also temperature and more stuff...
+-- api_key = demo instances already have one
+model_name = 'gpt-4', -- you can also use text-davinci-003 or gpt-3.5-turbo
+prompt_template = '{{text}}';
+```
+Then paste the login and password into secrets. The project will start.
+

script.py

@@ -1,5 +1,6 @@
 import blocking_api
 import gradio as gr
+import time
 
 
 def setup():
@@ -7,6 +8,8 @@ def setup():
 setup()
 
 with gr.Blocks() as demo:
-    gr.Markdown('Api is working')
+    time.sleep(60)
+    with open('main.md', 'r') as f:
+        gr.Markdown(f.read())
 
 demo.launch()