How can I deploy the model to a website or anything that is not in jupyter notebook
#17
by
nutkung1
- opened
How can I deploy the model to a website or anything that is not in jupyter notebook
You can install text generation webui and launch the program with command --listen which will let you log in using a browser as long as you can connect to the pc's IP. Look up youtube videos about it, it's pretty popular for running models on your pc using cpu or gpu.
Here's the link: https://github.com/oobabooga/text-generation-webui
yeah. then, once you get to any amount of scaling, come back for the paragraphs of convo it will take to hash out.
