Commit History

add prompt formating
ea46c22
unverified

makaveli commited on

update README for phi support
95bcc6a

makaveli10 commited on

add support for phi
5d7959c

makaveli10 commited on

fix: end of segment
795e5f6

makaveli10 commited on

Update llm_service.py to tensorrt-llm 0.7.1
855f306
unverified

makaveli commited on

add client instructions to readme
91de2f7

makaveli10 commited on

add run_client script to start client
d4294c9

makaveli10 commited on

update requirements
6e3682e

makaveli10 commited on

update README
850e3c7

makaveli10 commited on

update server.py
94498e7

makaveli10 commited on

add whisper bot client
456c9bb

makaveli10 commited on

add model_name to whisper tensorrt build command
a291214

makaveli10 commited on

add README
90a66d9

makaveli10 commited on

add README
201d841

makaveli10 commited on

add whisper output to queue for llm process
f1e930a

makaveli10 commited on

add sleep to backg thread
e5e84e9

makaveli10 commited on

add multiprocess communication
7cc82ad

makaveli10 commited on

add mistral LLM
201054b

makaveli10 commited on

trt whisper live
6c3262d

makaveli10 commited on

Initial commit
06d32c0
unverified

Marcus Edel commited on