lmdeploy usage
#4
by
jzchai-exwzd
- opened
Is it possible to use it with lmdeploy yet?
I got
RuntimeError: [TM][ERROR] Assertion fail: /lmdeploy/src/turbomind/python/bind.cpp:294
when trying to run it with
lmdeploy serve api_server internlm/internlm-xcomposer2d5-7b
With or without the "--backend turbomind" option, it was the same error.
