Demo running on google colab
#3
by
sivan22
- opened
for whoever may be concerned, i've made a simple demo that could be run on a free tier google colab: https://colab.research.google.com/drive/1hn23eA4m7ISW2e40DsAB6sbLRok4RKqS?usp=sharing
all you need is to register to ngrok.com and enter your authentication code in the notebook.
a sample image:
Please add to the README and open a PR so I can merge it in to the model card :)
You may also use this Colab:
https://gist.github.com/Norod/11997c0c9a330d0eeb9a6d4791b9aa2f
It uses deep speed for faster inference, text streamer to get the results as they are being generated and it's using Gradio to show a built in embdedded widget.
@Shaltiel Sure, here you go: https://huggingface.co/dicta-il/dictalm-7b-instruct/discussions/6
Thanks!
Shaltiel
changed discussion status to
closed