WhisperFusion / llm_service.py

Commit History

add: dolphin model inference; chatml prompt format
28cd485

makaveli10 commited on

fix: strip() on list
5d9af51

makaveli10 commited on

add history of conversation to prompt
e3f7cd8

makaveli10 commited on

send llm response with eos
3a0cae9

makaveli10 commited on

integrate whisperspeech
16388cf

makaveli10 commited on

optimizations
9dcd6a2

makaveli10 commited on

add prompt formating
ea46c22
unverified

makaveli commited on

Update llm_service.py to tensorrt-llm 0.7.1
855f306
unverified

makaveli commited on

add whisper output to queue for llm process
f1e930a

makaveli10 commited on

add sleep to backg thread
e5e84e9

makaveli10 commited on

add multiprocess communication
7cc82ad

makaveli10 commited on