Python API
#18
by
cgarijo-Ci21
- opened
First of all, thanks for the model and the work that this implies. This model is awesome and goes very well.
Is there a Python API available for using this model locally? I want to use this model and functions as a part of a bigger python project and I would like to handle it as another library of the project instead of making calls from CLI or the WEBUI.
Another reason I would like this "pythonic" API is because I will be performing asynchronous calls to the model for a certain period of time, and making the call from the CLI supposes to load the model in GPU every time, while with python I can just load the model and keep it on memory until every process exits.
Thank you in advance and congratulations for all the work!