llmixer
/

Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2 / README.md

llmixer's picture

Update README.md

284a4f0 verified 6 months ago

|

history blame contribute delete

164 Bytes

	---
	pipeline_tag: text-generation
	license: llama3
	---
	8.1 bpw exl2 quant of [Meta-Llama-3-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct)