New discussion

Join LMSYS Chatbot Arena?

1
#11 opened 26 days ago by Light4Bear

Ollama support

1
#9 opened about 1 month ago by Dao3

MoE offloading strategy?

2
#8 opened about 1 month ago by Minami-su

Update README.md

#7 opened about 1 month ago by VanishingPsychopath

kv cache

2
#6 opened about 2 months ago by FrankWu

function/tool calling support

6
#5 opened about 2 months ago by kaijietti

fail to run the example

8
#4 opened about 2 months ago by Leymore

GPTQ plz

9
#3 opened about 2 months ago by xuchen123

vllm support

6
#2 opened about 2 months ago by Sihangli

llama.cpp support

5
#1 opened about 2 months ago by cpumaxx