70B model?
#1
by
rocca
- opened
I'm wondering if you trained a 70b Llama 2 accelerator, and if so, whether you could release it?
Hi @rocca , we have trained an early version of llama3-70b speculator. We are planning on improving it first, and following it up with a llama2-70b speculator. Thanks for your interest! Hopefully soon 🤞
Great to hear! Keenly looking forward to trying out llama2-70b speculator.