Try to use a working inference for this?
#2
by
p0l4k
- opened
Maybe this one will help to figure out the inference problem?
https://github.com/vikhyat/mixtral-inference
Maybe this one will help to figure out the inference problem?
https://github.com/vikhyat/mixtral-inference