Spaces:
Paused
Paused
No endpoint section in new .env structure? (required for local inference server)
#125
by
RobertoDonPedro
- opened
Hi, I've seen that you've restructured the .env file, appreciate that.
However, I'm missing an "endpoint" section where I could set my local inference server.
Previously that was "endpoint": "http://127.0.0.1:8081/generate_stream". How would I do this in the new config??
Sorry
@coyotte508
, I just saw the solution is outlined in the README yet.
MODELS=[{"name": "...", "endpoints": [{"url": "127.0.0.1:8080/generate_stream"}]}]
Closing this!
RobertoDonPedro
changed discussion status to
closed
did you manage to get it to work @RobertoDonPedro ? would love to hear more!
Yes thanks @julien-c , I've closed it yet.