LLMServer / main /api.py

Commit History

Changed Generate stream to async
50e2fd2

AurelioAguirre commited on

added mps and cput initialization
1b76f70

AurelioAguirre commited on

Added double init, for embedding and chat models at the same time.
8083005

AurelioAguirre commited on

Added Progressbar, REPLACED stream to logger
8f95297

AurelioAguirre commited on

Added Progressbar, removed stream to logger
9b61f35

AurelioAguirre commited on

Added Progressbar with stream to logger
0f26bbb

AurelioAguirre commited on