Biomed Foundation Model
1
#4 opened 27 days ago
by
amrothemich
Yi-34B AQLM?
#3 opened about 1 month ago
by
llama-anon
![](https://cdn-avatars.huggingface.co/v1/production/uploads/643344526c2a26ae66d5d5b0/VotgxEYpg6YQ_eMwhMqac.jpeg)
~8 tok/sec with ~5k context on vLLM with Flash Attention and `kv_cache_dtype="fp8"` on 3090TI 24GB VRAM
2
#2 opened about 1 month ago
by
ubergarm