nm-testing
/

Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token

Commit History

Updated compression_config to quantization_config

58c2468
verified

mgoin commited on Oct 9

Upload folder using huggingface_hub

5ab9371
verified

robertgshaw2 commited on Jun 23

initial commit

423a191
verified

robertgshaw2 commited on Jun 23