@KnutJaegersberg on Hugging Face: "neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8 Requant of the big llama, using…"

Join the community of Machine Learners and AI enthusiasts.

posted an update Jul 30

Post

922

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Requant of the big llama, using 20% less memory

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

In this post