Edit Models filters

Model Tree

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

1

Full-text search

Active filters: hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

DuologueSystems/70B-gptq_qlora

Updated Oct 29 • 2