Multi GPU Setup
#52
by
Ayush8120
- opened
Can I inference this using multi GPU setup ? Also, can we expect Mistral support on lmsys soon?
maybe cc @zhisbug @lmzheng @DachengLi from Lmsys
@Ayush8120
It is available now at https://chat.lmsys.org/?single under both the single model tab and arena tab.
It is also supported by our https://github.com/lm-sys/FastChat with multi-GPU support.
Ayush8120
changed discussion status to
closed